-- Logs begin at Tue 2022-05-10 01:38:18 UTC, end at Tue 2022-05-10 03:39:52 UTC. -- May 10 03:05:20.297328 dv-cinder-830094-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 03:05:20.304588 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 03:05:20 2022] *** May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: nodename: dv-cinder-830094-4-iscsi May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: machine: x86_64 May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: clock source: unix May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: pcre jit disabled May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: detected number of CPU cores: 4 May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: current working directory: / May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: detected binary path: /usr/bin/uwsgi-core May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: your processes number limit is 47680 May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: your memory page size is 4096 bytes May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: detected max file descriptor number: 2048 May 10 03:05:20.312957 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: lock engine: pthread robust mutexes May 10 03:05:20.313756 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: thunder lock: enabled May 10 03:05:20.313756 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 03:05:20.313756 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 03:05:20.358459 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: Python main interpreter initialized at 0x55f7927169c0 May 10 03:05:20.358459 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: python threads support enabled May 10 03:05:20.358459 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: your server socket listen backlog is limited to 100 connections May 10 03:05:20.358459 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: your mercy for graceful operations on workers is 90 seconds May 10 03:05:20.358806 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: mapped 403077 bytes (393 KB) for 2 cores May 10 03:05:20.358881 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: *** Operational MODE: preforking *** May 10 03:05:20.359106 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: *** uWSGI is running in multiple interpreter mode *** May 10 03:05:20.359106 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: spawned uWSGI master process (pid: 102772) May 10 03:05:20.359310 dv-cinder-830094-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 03:05:20.360380 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: spawned uWSGI worker 1 (pid: 102773, cores: 1) May 10 03:05:20.360380 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: spawned uWSGI worker 2 (pid: 102774, cores: 1) May 10 03:05:20.360380 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 03:05:21.556528 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 03:05:21.562291 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 03:05:22.292561 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:05:22.292561 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: from cryptography.utils import int_from_bytes May 10 03:05:22.292907 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:05:22.292907 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: from cryptography.utils import int_from_bytes May 10 03:05:22.293175 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:05:22.293175 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: from cryptography.utils import int_from_bytes May 10 03:05:22.293500 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:05:22.293500 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: from cryptography.utils import int_from_bytes May 10 03:05:24.863066 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 03:05:24.863646 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 03:05:24.863835 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 03:05:24.864194 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 03:05:24.864451 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 03:05:24.864789 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 03:05:24.865190 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.865295 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 03:05:24.865388 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.865477 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.865566 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 03:05:24.865790 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.865920 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 03:05:24.866116 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.866204 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 03:05:24.866424 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.866560 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.866743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.866891 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.867062 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.867219 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.867387 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.867542 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.867636 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.867877 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.867978 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.868237 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.868477 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830094-4-iscsi {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.868573 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.868841 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.868930 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.869155 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.869242 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.869469 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.869570 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.869786 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.869872 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.870089 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.870174 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830094-4-iscsi {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.870409 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.870506 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.870715 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.870809 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.871032 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.871220 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.871363 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.871655 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.871824 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.871970 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.872111 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.872260 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.872607 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.872724 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.872859 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.872961 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.873103 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.873193 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.873415 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.873520 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.873729 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.873815 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.874069 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.874169 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.874387 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.874484 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.874706 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.874794 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830094-4-iscsi {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.875029 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.875117 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.875347 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.875545 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.875666 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.875782 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.875982 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.876111 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.876368 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830094-4-iscsi {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.876562 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.876734 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.876896 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.877048 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.877199 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.877335 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.877467 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.877633 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.877768 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.877960 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.878103 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.878280 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.878430 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.878599 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.878734 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.878919 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.879059 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.879210 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.879344 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.879515 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.879656 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.879824 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.879963 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.880140 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.880286 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.880443 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.880532 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.880779 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.880872 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.881030 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.881119 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.881345 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.881444 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.881663 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.881753 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.881984 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.882071 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.882304 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.882409 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.882556 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.882697 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.882792 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.882873 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.883109 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.883206 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.883426 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.883520 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.884295 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.884414 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.884608 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.884743 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.884946 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.885034 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.885256 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.885353 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.885565 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.885662 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.885875 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.885963 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.886186 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.886301 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.886492 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.886589 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.886809 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.886904 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.887120 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.887220 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.887433 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.887528 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.887740 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.887826 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.888050 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.888164 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.888372 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.888460 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.888710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.888801 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.889042 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.889141 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.889355 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.889454 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.889676 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.889764 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.890002 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.890090 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.890318 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.890412 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.890631 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.890725 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.890939 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.891032 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.891252 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.891340 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.891560 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.891647 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.891877 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.891965 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.892198 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.892286 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.892504 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.892592 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.892779 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.892870 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.893086 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.893173 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.893394 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.893484 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.893713 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.893809 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.894022 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.894111 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.894306 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.894435 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.894616 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.894722 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.894914 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.895017 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.895225 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.895331 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.895535 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.895630 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.895842 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.895937 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.896151 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.896256 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.896451 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.896546 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.896779 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.896868 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.897089 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.897192 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.897401 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.897555 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.897697 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.897834 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.898010 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.898155 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.898304 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.898447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.898620 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.898757 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.898924 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.899072 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.899286 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.899947 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.900230 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.900368 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.900629 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.900779 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.900968 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.901129 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.901273 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.901655 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.901844 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.901985 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.902159 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.902299 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.902481 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.902624 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.902838 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.902975 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.903097 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.903185 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.903404 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.903498 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.903724 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.903814 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.904025 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.904114 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.904335 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.904481 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.904675 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.904775 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.904979 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.905067 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.905286 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.905374 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.905591 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.905679 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.905894 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.905982 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.906195 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.906306 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.906502 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.906604 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.906802 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.906891 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.907104 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.907205 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.907402 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.907490 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.907708 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.907793 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.908017 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.908118 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.908321 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.908407 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.908626 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.908791 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.908956 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.909054 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.909271 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.909365 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.909596 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.909681 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.909908 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.909997 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.910222 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.910310 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.910534 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.910621 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.910858 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:05:24.910946 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.911184 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.911276 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.911509 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.911614 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.911820 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.911909 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.912136 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.912224 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.912460 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.912559 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.912797 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.912905 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.913111 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.913204 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.913423 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.913520 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.913742 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.913829 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.914059 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.914153 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.914378 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.914511 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.915013 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.915147 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.915147 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.915373 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.915458 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.915546 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.915663 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.915752 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.915997 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.916084 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.916320 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.916417 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.916643 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.916751 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.916991 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.917093 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.917310 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.917409 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.917637 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.917725 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.917972 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.918058 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.918293 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.918388 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.918608 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.918693 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.918917 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.919003 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.919228 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.919316 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.919538 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.919624 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.919859 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.919948 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.920191 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.920280 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.920505 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.920593 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.920850 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.920950 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.921170 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.921267 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.921497 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.921594 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.921813 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.921908 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.922126 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.922215 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.922438 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.922534 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.922755 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.922850 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.923072 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.923159 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.923386 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.923472 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.923699 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.923795 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.924014 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.924100 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.924328 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.924415 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.924640 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.924815 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.924976 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.925064 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.925282 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.925370 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.925585 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.925756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.925889 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.925977 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.926199 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.926286 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.926504 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.926601 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.926823 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.926912 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.927131 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.927219 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.927436 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.927523 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.927748 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.927834 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.928055 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.928140 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.928364 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.928452 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.928689 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.928782 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.929004 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.929093 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.929308 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.929398 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.929621 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.929722 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.929930 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.930018 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.930233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.930329 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.930609 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.930718 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.930912 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.931013 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.931223 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.931367 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.931547 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.931691 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.931853 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.931986 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.932156 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.932315 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.932468 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.932631 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.932801 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.932966 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.933115 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.933296 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.933426 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.933607 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.933736 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.933917 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.934056 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.934235 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.934367 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.934551 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.934681 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.934868 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.935016 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.935193 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.935343 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.935509 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.935648 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.935835 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.935969 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.936151 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.936291 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.936469 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.936605 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.936830 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.936920 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.937165 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.937263 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.937475 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.937572 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.937802 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.937890 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.938102 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.938190 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.938408 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.938498 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.938708 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.938796 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.939011 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.939099 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.939313 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.939402 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.939614 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.939701 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.939915 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.940004 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.940224 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.940311 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.940528 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.940613 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.940856 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.940944 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.941161 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.941248 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.941465 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.941551 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.941770 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.941875 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.942094 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.942180 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.942403 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.942490 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.942713 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.942810 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.943023 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.943123 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.943330 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.943418 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.943656 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.943753 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.943970 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.944058 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.944277 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.944376 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.944590 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.944710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.944938 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.945029 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.945250 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.945337 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.945570 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.945672 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.945881 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.945969 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.946714 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.946809 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.947119 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.947263 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.947439 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.947528 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.947751 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.947840 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.948072 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.948161 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.948378 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.948467 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.948712 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.948808 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.949051 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.949141 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.949379 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.949473 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.949693 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.949788 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.950013 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.950100 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.950318 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.950403 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.950631 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.950725 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.950940 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.951037 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.951251 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.951338 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.951562 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.951661 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.951877 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.951967 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.952196 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.952282 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.952507 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.952603 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.952846 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.952943 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.953152 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.953239 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.953466 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.953562 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.953772 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.953866 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.954089 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.954178 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.954392 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.954481 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.954705 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.954800 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.955014 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.955109 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.955339 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.955436 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.955642 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.955729 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.955954 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.956041 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.956259 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.956352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.956569 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.956714 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.956904 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.957044 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.957216 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.957314 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.957521 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.957610 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.957824 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.957929 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.958133 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.958229 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.958447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.958568 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.958758 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.958855 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.959066 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.959153 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.959371 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.959458 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.959677 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.959771 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.959983 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.960069 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.960286 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.960375 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.960588 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.960708 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.960926 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.961012 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.961235 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.961340 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.961547 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.961634 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.962491 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.962634 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.962804 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.962937 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.963136 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.963247 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.963428 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.963535 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.963755 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.963858 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.964073 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.964167 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.964398 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.964486 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.964750 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.964844 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.965057 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.965154 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.965366 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.965453 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.965695 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.965791 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.966001 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.966098 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.966309 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.966394 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.966618 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.966715 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.966925 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.967013 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.967239 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.967331 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.967547 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.967645 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.967854 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.967942 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.968173 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.968266 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.968482 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.968578 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.968821 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.968908 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.969135 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.969221 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.969447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.969552 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.969758 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.969853 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.970070 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.970165 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.970385 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.970472 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.970691 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.970786 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.971002 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.971089 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.971312 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.971408 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.971615 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.971703 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.971929 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.972015 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.972242 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.972329 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.972557 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.972831 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.972937 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.973166 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.973256 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.973483 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.973571 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.973797 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.973893 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.974115 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.974204 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.974436 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.974681 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.974776 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.975019 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.975120 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.975340 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.975428 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.975669 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.975767 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.975992 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.976091 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.976299 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.976388 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.976603 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.976722 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.976940 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.977028 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.977247 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.977364 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.977633 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.977740 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.977952 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.978073 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.978261 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.978365 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.978571 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.978659 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.978886 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.978972 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.979195 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.979291 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.979501 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.979587 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.979806 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.979903 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.980106 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.980268 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.980412 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.980497 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.980736 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.980826 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.981044 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.981138 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.981352 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.981440 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.981652 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.981738 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.981960 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.982045 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.982260 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.982344 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.982572 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.982722 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.982892 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.983025 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.983179 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.983315 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.983488 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.983641 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.983799 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.983903 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.984105 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.984190 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.984419 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.984520 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.984762 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.984851 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.985068 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.985153 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.985371 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.985470 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.985671 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.985758 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.985980 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.986079 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.986282 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.986378 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.986583 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.986669 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.986891 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.986976 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.987202 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.987310 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.987510 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.987619 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.987820 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.987971 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.988121 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.988258 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.988414 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.988554 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.988822 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.988911 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.989040 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.989138 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.989347 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.989436 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.989648 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.989737 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.989948 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.990037 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.990255 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.990344 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.990559 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.990655 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.990868 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.990955 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.991174 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.991261 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.991477 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.991573 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.991784 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.991872 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.992092 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.992178 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.992395 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.992493 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.992717 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.992808 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.993556 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.993655 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.993866 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.994039 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.994169 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.994258 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.994481 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.994568 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.994788 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.994877 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.995090 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.995177 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.995391 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.995479 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.995699 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.995789 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.995999 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.996138 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.996303 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.996399 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.996609 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.996725 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.996943 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.997037 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.997250 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.997359 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.997551 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.997642 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.997873 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.998006 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.998157 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.998254 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.998463 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.998551 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.998766 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.998858 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.999073 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.999170 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.999375 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.999470 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.999676 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.999764 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:24.999977 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.000074 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.000280 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.000368 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.000583 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.000705 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.000919 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.001020 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.001228 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.001323 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.001532 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.001617 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.001836 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.001923 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.002135 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.002230 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.002443 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.002530 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.002768 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.002904 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.003080 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.003178 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.003390 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.003485 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.003698 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.003787 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.004005 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.004093 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.004315 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.004402 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.004629 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.004742 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.004967 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.005064 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.005273 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.005370 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.005588 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.005689 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.005900 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.005995 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.006212 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.006314 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.006516 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.006612 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.006820 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.006909 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.007126 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.007221 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.007437 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.007565 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.007748 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.007845 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.008063 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.008159 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.008370 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.008458 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.009260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.009424 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.009590 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.009765 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.009909 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.010051 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.010224 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.010371 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.010549 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.010683 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.010875 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.010996 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.011203 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.011290 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.011511 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.011611 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.011824 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.011913 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.012140 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.012227 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.012454 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.012551 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.012791 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.012885 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.013107 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.013205 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.013423 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.013512 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.013735 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.013831 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.014040 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.014137 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.014354 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.014453 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.014663 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.014767 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.014967 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.015064 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.015275 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.015363 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.015581 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.015668 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.015892 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.015988 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.016211 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.016348 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.016523 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.016637 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.016914 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.017017 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.017228 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.017324 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.017536 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.017664 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.017853 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.017942 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.018161 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.018249 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.018476 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.018588 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.018788 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.018907 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.019094 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.019222 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.019507 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.019601 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.019820 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.019909 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.020132 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.020220 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.020445 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.020532 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.020770 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.020864 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.021075 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.021165 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.021386 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.021483 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.021710 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.021798 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.022013 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.022109 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.022317 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.022414 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.022626 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.022714 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.022946 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.023074 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.023251 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.023351 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.023570 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.023657 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.023875 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.023993 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.024185 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.024889 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.025045 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.025364 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.025452 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.025675 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.025775 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.026004 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.026100 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.026390 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.026728 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.026964 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.027060 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.027273 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.027367 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.027596 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.027683 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.027903 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.028014 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.028216 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.028311 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.028527 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.028623 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.028879 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.028981 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.029204 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.029309 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.029520 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.029610 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.029837 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.029932 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.030142 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.030243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.030462 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.030551 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.030784 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.030880 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.031097 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.031193 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.031414 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.031502 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.031724 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.031813 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.032052 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.032150 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.032378 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.032467 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.032714 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.032808 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.033042 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.033173 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.033371 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.033459 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.033676 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.033765 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.033987 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.034076 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.034294 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.034383 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.034598 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.034696 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.034919 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.035007 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.035223 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.035311 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.035535 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.035631 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.035848 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.035937 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.036156 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.036244 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.036459 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.036556 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.036785 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.036876 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.037109 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.037198 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.037412 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.037510 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.037733 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.037820 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.038039 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.038136 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.038345 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.038437 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.038663 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.038751 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.038969 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.039059 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.039290 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.039379 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.039599 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.039694 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.040515 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.040619 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.040872 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.040992 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.041186 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.041307 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.041516 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.041656 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.041831 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.041967 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.042142 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.042291 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.042468 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.042622 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.042782 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.042959 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.043134 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.043268 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.043447 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.043591 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.043774 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.043916 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.044109 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.044231 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.044439 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.044545 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.044780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.044886 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.045126 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.045270 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.045456 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.045589 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.045772 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.045896 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.046078 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.046196 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.046385 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.046504 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.046690 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.046808 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.046996 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.047110 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.047296 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.047421 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.049734 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.049873 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.049968 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050055 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050055 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050225 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050308 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050389 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050470 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050550 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050641 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050723 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050803 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050883 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.050963 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051200 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051200 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051355 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051444 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051605 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051691 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051771 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051851 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.051932 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052013 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052107 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052191 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052272 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052352 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052433 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052514 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052603 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052755 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.052860 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.053072 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.053161 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.053390 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.053480 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.053704 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.053792 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.054018 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.054106 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.054334 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.054432 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.054649 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.054744 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.054956 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.055052 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.055272 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.055363 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.055620 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.055710 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.056028 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.056210 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.056377 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.056531 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.056708 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.056878 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.057029 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.057189 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.057377 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.057531 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.057699 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.057851 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.058022 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.058181 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.058331 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.058480 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.058637 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.058787 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.058938 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.059098 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.059248 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.059396 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.059545 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.059695 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.059863 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.060015 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.060164 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.060314 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.060566 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.060698 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.060784 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.060878 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.061067 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.061157 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.061382 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.061480 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.061695 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.061792 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.062008 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.062098 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.062360 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.062517 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.062681 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.062770 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.062984 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.063084 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.063299 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.063407 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.063610 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.063702 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.063906 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.063997 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.064217 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.064310 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.064530 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.064619 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.064867 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.064972 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.065181 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.065271 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.065491 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.065581 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.065801 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.065900 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.066112 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.066202 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.066424 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.066525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.066740 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.066828 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.067057 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.067147 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.067372 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.067461 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.067680 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.067769 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.067991 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.068080 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.068301 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.068391 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.068640 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.068847 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.068984 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.069165 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.069300 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.069502 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.069600 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.069827 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.069917 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.070150 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.070485 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.070632 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.070753 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.070842 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.071229 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.071487 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.071487 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.071652 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.071743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.071825 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.072019 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.072140 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.072327 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.072436 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.072646 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.072803 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.072992 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.073118 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.073305 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.073428 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.073611 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.073745 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.073931 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.074058 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.074241 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.074378 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.074702 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.074787 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.075018 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.075104 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.075335 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.075429 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.075660 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.075753 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.075972 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.076058 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.076339 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.076510 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.076647 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.076885 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.076983 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.077210 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.077305 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.077540 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.077627 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.077869 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.077956 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.078183 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.078270 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.078487 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.078573 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.078791 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.078878 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.079101 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.079189 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.079407 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.079491 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.079707 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.079791 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.080016 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.080116 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.080320 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.080405 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.080632 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.080869 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.080963 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.081046 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.081251 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.081341 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.081554 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.081670 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.081866 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.081955 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.082169 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.082265 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.082477 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.082575 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.082781 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.082870 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.083082 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.083172 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.083388 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.083484 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.083694 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.083801 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.084003 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.084102 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.084306 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.084402 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.084611 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.084724 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.084938 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.085035 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.085247 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.085343 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.085553 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.085638 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.085868 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.085953 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.086177 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.086275 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.086487 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.086573 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.087339 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.087447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.087654 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.087828 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.088089 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.088187 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.088422 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.088517 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.088762 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.088864 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.089073 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.089167 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.089395 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.089490 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.089711 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.089939 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.090035 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.090272 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.090358 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.090596 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.090714 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.090930 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.091032 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.091258 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.091346 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.091566 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.091812 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.091913 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.092151 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.092239 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.092478 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.092566 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.092813 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.092913 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.093128 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.093216 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.093439 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.093528 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.093749 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.093831 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.094060 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.094155 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.094367 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.094453 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.094676 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.094769 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.094985 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.095079 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.095293 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.095380 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.095600 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.095687 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.095908 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.096007 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.096216 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.096311 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.096526 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.096613 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.096874 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.096973 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.097191 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.097279 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.097506 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.097593 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.097820 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.097919 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.098134 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.098221 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.098440 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.098533 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.098750 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.098839 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.099058 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.099144 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.099380 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.099474 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.099698 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.099785 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.100017 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.100114 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.100333 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.100418 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.100643 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.100765 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.100980 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.101104 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.101307 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.101415 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.101631 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.101721 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.101966 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.102058 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.102286 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.102437 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.103269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.103362 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.103634 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.103730 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.103954 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.104068 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.104275 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.104365 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.104587 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.104691 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.104963 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.105071 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.105300 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.105388 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.105625 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.105713 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.105949 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.106046 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.106252 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.106340 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.106557 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.106647 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.106861 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.106951 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.107172 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.107262 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.107488 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.107586 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.107796 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.107885 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.108101 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.108190 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.108403 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.108501 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.108735 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.108829 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.109043 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.109132 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.109347 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.109450 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.109649 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.109738 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.109950 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.110047 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.110258 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.110431 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.110560 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.110658 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.110939 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.111043 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.111183 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.111275 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.111450 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.111539 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.111750 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.111847 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.112050 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.112140 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.112355 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.112444 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.112670 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.112773 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.112986 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.113117 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.113287 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.113384 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.113589 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.113678 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.113888 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.113992 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.114200 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.114300 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.114508 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.114608 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.114816 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.114905 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.115125 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.115214 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.115433 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.115532 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.115744 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.115833 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.116049 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.116143 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.116368 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.116470 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.116706 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.116801 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.117022 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.117113 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.117329 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.117427 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.117660 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.117750 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.117990 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.118083 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.118315 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.118545 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.118640 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.118923 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.119019 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.119230 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.119326 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.119540 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.119630 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.119853 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.119942 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.120179 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.120275 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.120483 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.120571 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.120832 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.120924 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.121153 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.121301 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.121469 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.121558 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.121783 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.121871 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.122098 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.122186 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.122424 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.122511 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.122734 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.122821 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.123040 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.123136 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.123359 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.123448 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.123671 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.123769 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.123984 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.124073 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.124300 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.124399 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.124610 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.124733 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.124959 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.125049 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.125272 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.125360 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.125595 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.125692 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.125916 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.126004 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.126233 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.126321 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.126554 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.126642 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.126870 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.126957 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.127199 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.127289 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.127508 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.127597 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.127821 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.127918 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.128124 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.128213 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.128366 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 03:05:25.128491 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.128837 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.129189 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.129522 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.129839 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.130158 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.130467 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:05:25.130714 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 03:05:25.152626 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG oslo_db.sqlalchemy.engines [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:05:25.154175 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_db.sqlalchemy.engines [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:05:25.215460 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.context [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3598736-4bcc-4a19-a7cb-e3b3f613b640(cell1) {{(pid=102773) load_cells /opt/stack/nova/nova/context.py:464}} May 10 03:05:25.217124 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.context [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3598736-4bcc-4a19-a7cb-e3b3f613b640(cell1) {{(pid=102774) load_cells /opt/stack/nova/nova/context.py:464}} May 10 03:05:25.219778 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG oslo_concurrency.lockutils [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:25.221401 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG oslo_concurrency.lockutils [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:25.221499 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:25.222191 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG oslo_concurrency.lockutils [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:25.222985 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:25.223780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:25.224105 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG oslo_concurrency.lockutils [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:25.225732 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:25.235503 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG oslo_db.sqlalchemy.engines [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:05:25.239283 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG oslo_db.sqlalchemy.engines [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:05:25.242406 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_db.sqlalchemy.engines [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:05:25.247039 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_db.sqlalchemy.engines [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:05:25.401707 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG oslo_db.sqlalchemy.engines [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:05:25.406494 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_db.sqlalchemy.engines [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:05:25.742129 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: WARNING keystonemiddleware.auth_token [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:05:25.749070 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: WARNING keystonemiddleware.auth_token [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:05:25.749994 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: WARNING keystonemiddleware.auth_token [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:05:25.756328 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: WARNING keystonemiddleware.auth_token [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:05:26.100714 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: WARNING keystonemiddleware.auth_token [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:05:26.102497 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: WARNING keystonemiddleware.auth_token [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:05:26.106840 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: WARNING keystonemiddleware.auth_token [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:05:26.108541 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: WARNING keystonemiddleware.auth_token [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:05:26.112889 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f7927169c0 pid: 102773 (default app) May 10 03:05:26.114485 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f7927169c0 pid: 102774 (default app) May 10 03:05:26.114958 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:26.116121 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-8228804a-e5a4-4b40-8107-4a5e6748dd89 None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001704 May 10 03:05:26.116530 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Tue May 10 03:05:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:44.446801 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:44.448016 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 May 10 03:06:44.448428 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:44.886170 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-15eed0c4-e099-41f7-b7b0-f2d6ec6392ff admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:44.916851 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-15eed0c4-e099-41f7-b7b0-f2d6ec6392ff admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462307 May 10 03:06:44.917400 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 10 03:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:47.217141 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:47.218694 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-f6c39365-a602-42c6-9a00-bc7670cc1b8b None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 May 10 03:06:47.219092 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 2/4] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:47.277383 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-09f966e4-bc46-4ff1-88d8-e509bd3b8f33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:47.297300 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:06:47.297300 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: warnings.warn(msg) May 10 03:06:47.328270 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-09f966e4-bc46-4ff1-88d8-e509bd3b8f33 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103215 May 10 03:06:47.333575 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 3/5] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:06:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:06:47.548159 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-3efdff2b-a5ab-4f4a-96da-075eafea5884 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:47.550620 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:06:47.550620 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: warnings.warn(msg) May 10 03:06:47.597307 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-3efdff2b-a5ab-4f4a-96da-075eafea5884 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260168 May 10 03:06:47.598100 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 3/6] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 10 03:06:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:49.908786 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-09f966e4-bc46-4ff1-88d8-e509bd3b8f33 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:49.909808 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-09f966e4-bc46-4ff1-88d8-e509bd3b8f33 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 10 03:06:49.910216 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 4/7] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:50.015081 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-5038dd2b-66cb-4204-8044-66a22b81f846 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "name": "ds512M", "swap": 0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:50.036363 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:06:50.036363 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: warnings.warn(msg) May 10 03:06:50.057200 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-5038dd2b-66cb-4204-8044-66a22b81f846 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140119 May 10 03:06:50.057975 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 4/8] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:06:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:06:50.069339 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-3dad6f82-9a94-4e18-b891-87fe4ad6c59c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:50.070853 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:06:50.070853 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: warnings.warn(msg) May 10 03:06:50.103218 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-3dad6f82-9a94-4e18-b891-87fe4ad6c59c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036971 May 10 03:06:50.113228 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 5/9] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 10 03:06:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:06:52.397798 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-5038dd2b-66cb-4204-8044-66a22b81f846 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:52.398818 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-5038dd2b-66cb-4204-8044-66a22b81f846 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 10 03:06:52.399625 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:06:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:52.465681 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-49479960-bc47-410f-9f03-4660e8a14cff admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "id": "d2"}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:52.485116 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-49479960-bc47-410f-9f03-4660e8a14cff admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078767 May 10 03:06:52.485934 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 6/11] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:06:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:06:52.497575 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-5c4c6440-8660-407e-b24e-6d137fae725e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:52.520872 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-5c4c6440-8660-407e-b24e-6d137fae725e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027126 May 10 03:06:52.532704 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 6/12] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 10 03:06:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:54.808228 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-49479960-bc47-410f-9f03-4660e8a14cff admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:54.809491 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-49479960-bc47-410f-9f03-4660e8a14cff admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 May 10 03:06:54.809912 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 7/13] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:06:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:54.874608 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-00c875a9-0201-4fcb-a0fe-82ae43d8ecef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:54.894466 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-00c875a9-0201-4fcb-a0fe-82ae43d8ecef admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078137 May 10 03:06:54.896903 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 7/14] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:06:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:06:54.910252 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-7bec2723-a95e-44f9-b81f-a59d0a646bd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:54.938365 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-7bec2723-a95e-44f9-b81f-a59d0a646bd4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032622 May 10 03:06:54.939381 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 8/15] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 10 03:06:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:57.248103 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-00c875a9-0201-4fcb-a0fe-82ae43d8ecef admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:57.249246 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-00c875a9-0201-4fcb-a0fe-82ae43d8ecef admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 May 10 03:06:57.249673 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 8/16] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:57.310575 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-adc8ef3b-f701-4fa7-9555-df5f8b94a077 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "id": "d4", "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:57.329891 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-adc8ef3b-f701-4fa7-9555-df5f8b94a077 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073994 May 10 03:06:57.330525 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 9/17] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:06:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:06:57.342887 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-34c75d3f-5780-49f8-a246-dc8d6bfd9bb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:57.366844 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-34c75d3f-5780-49f8-a246-dc8d6bfd9bb0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027549 May 10 03:06:57.367894 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 9/18] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 10 03:06:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:59.655875 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-adc8ef3b-f701-4fa7-9555-df5f8b94a077 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:59.656989 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-adc8ef3b-f701-4fa7-9555-df5f8b94a077 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 10 03:06:59.657421 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 10/19] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:59.717942 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-cd89d19e-2f66-48e5-9b6e-786c4aa07c6c admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:59.745095 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-cd89d19e-2f66-48e5-9b6e-786c4aa07c6c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080699 May 10 03:06:59.745765 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 10/20] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 10 03:06:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:07:02.118772 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-adc8ef3b-f701-4fa7-9555-df5f8b94a077 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:02.119783 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-adc8ef3b-f701-4fa7-9555-df5f8b94a077 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 10 03:07:02.120184 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 11/21] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:02.179091 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-6cef0cea-7079-48c3-ac68-9b14c16d6229 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:02.198010 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-6cef0cea-7079-48c3-ac68-9b14c16d6229 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072080 May 10 03:07:02.198672 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 11/22] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:07:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:07:02.210243 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-b25973c1-11d7-4e0a-8df2-0cfdc44d161f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:02.236913 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-b25973c1-11d7-4e0a-8df2-0cfdc44d161f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030262 May 10 03:07:02.237547 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 12/23] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 10 03:07:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:07:04.545273 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-6cef0cea-7079-48c3-ac68-9b14c16d6229 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:04.546306 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-6cef0cea-7079-48c3-ac68-9b14c16d6229 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 10 03:07:04.546714 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:04.615452 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-ec567231-eb09-491c-84ef-99aec0bf1e0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:04.634545 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-ec567231-eb09-491c-84ef-99aec0bf1e0d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081367 May 10 03:07:04.635329 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 13/25] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:07:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:07:04.652006 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-e34c83ab-1c77-4861-a54c-c0cd907a28b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:04.675773 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-e34c83ab-1c77-4861-a54c-c0cd907a28b2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028309 May 10 03:07:04.677172 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 13/26] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 10 03:07:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:07:06.919312 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-ec567231-eb09-491c-84ef-99aec0bf1e0d admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:06.920408 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-ec567231-eb09-491c-84ef-99aec0bf1e0d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 May 10 03:07:06.920935 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 14/27] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:06.978716 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-b81847e2-3696-4520-99da-ea30dd6871ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:06.997604 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-b81847e2-3696-4520-99da-ea30dd6871ab admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070914 May 10 03:07:06.998253 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 14/28] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:07:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:07:07.010625 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-b96a3820-aeac-4d9a-a55a-2795d9ffa396 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:07.033686 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-b96a3820-aeac-4d9a-a55a-2795d9ffa396 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027458 May 10 03:07:07.034259 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 15/29] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 10 03:07:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:09.282252 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-b81847e2-3696-4520-99da-ea30dd6871ab admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:09.283259 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-b81847e2-3696-4520-99da-ea30dd6871ab admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 10 03:07:09.283673 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 15/30] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:09.346173 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-633fb1a5-2a94-4a1b-9290-3302895c7e44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "name": "m1.large", "vcpus": 4}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:09.365937 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-633fb1a5-2a94-4a1b-9290-3302895c7e44 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073509 May 10 03:07:09.366495 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 16/31] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:07:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:07:09.379074 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-9553323c-fe73-4fb3-b48d-edba07f1289f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:09.403572 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-9553323c-fe73-4fb3-b48d-edba07f1289f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028454 May 10 03:07:09.404145 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 16/32] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 10 03:07:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:11.755919 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-633fb1a5-2a94-4a1b-9290-3302895c7e44 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:11.757515 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-633fb1a5-2a94-4a1b-9290-3302895c7e44 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 May 10 03:07:11.758074 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 17/33] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:11.847055 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-14254fec-b6ba-4495-826d-86de1f30a00b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "id": "5"}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:11.865153 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-14254fec-b6ba-4495-826d-86de1f30a00b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.100703 May 10 03:07:11.866052 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 17/34] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 10 03:07:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:07:11.884146 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-22d66b89-ed2c-4645-af43-2e16c6aeb8d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:11.913212 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-22d66b89-ed2c-4645-af43-2e16c6aeb8d9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034910 May 10 03:07:11.913945 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 18/35] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 10 03:07:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:36.262556 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-14254fec-b6ba-4495-826d-86de1f30a00b admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:36.263545 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-14254fec-b6ba-4495-826d-86de1f30a00b admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 10 03:07:36.263940 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 18/36] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:07:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:36.320073 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-99f123fb-73e1-4ff2-afa4-bc8724c9200d admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:36.337057 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-99f123fb-73e1-4ff2-afa4-bc8724c9200d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067075 May 10 03:07:36.338290 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 19/37] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 10 03:07:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:07:37.341262 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-14254fec-b6ba-4495-826d-86de1f30a00b admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:37.342252 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-14254fec-b6ba-4495-826d-86de1f30a00b admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 10 03:07:37.342661 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 19/38] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:07:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:37.533283 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-58d8a7cf-33a6-45eb-9f37-e518c27f69c1 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:37.538731 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.wsgi [None req-58d8a7cf-33a6-45eb-9f37-e518c27f69c1 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-58d8a7cf-33a6-45eb-9f37-e518c27f69c1 admin admin] Request method failure captured: May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Accept: application/json May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Accept-Encoding: gzip, deflate May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Connection: keep-alive May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Content-Length: 0 May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Host: 10.222.0.55 May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Openstack-Api-Version: compute 2.90 May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Openstack-System-Scope: None May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: User-Agent: python-novaclient May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Auth-Token: gAAAAABiedb5JDQmZFtsdDrG0gwey7rqDpjMF75foD6somfe8y4CVbKSvp0oh0ygVIKuQeyZddvdA_QWaoYV8toCjfhGtLPQkgqEHxcNRGcIEzRqqlEb7YrYKPuJyT4cpl4l_ulkkcDiV_1ZA2SsoT2YJHSAAE3kEGjPBlknHnSEcJnppcpg-kY May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Domain-Id: None May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Domain-Name: None May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Identity-Status: Confirmed May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Is-Admin-Project: True May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Domain-Id: default May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Domain-Name: Default May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Name: admin May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Role: member,admin,reader May 10 03:07:37.542613 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Roles: member,admin,reader May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2e1554fd89594f468faedf42d5357b2f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2e1554fd89594f468faedf42d5357b2f"}]}] May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Tenant: admin May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Tenant-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Tenant-Name: admin May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User: admin May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Domain-Id: default May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Domain-Name: Default May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Id: d17410a7e6f74e8cbdb88de8e641816d May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Name: admin May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: method: > May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: exception: Flavor 42 could not be found. May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: action_args: {'id': '42'} May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:07:37.544352 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:37.545543 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:37.547052 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-58d8a7cf-33a6-45eb-9f37-e518c27f69c1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:07:37.548359 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-58d8a7cf-33a6-45eb-9f37-e518c27f69c1 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061325 May 10 03:07:37.548359 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 20/39] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 10 03:07:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 03:07:37.553734 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-f3554f34-9ca0-402d-9504-399191fb3e07 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:37.574270 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-f3554f34-9ca0-402d-9504-399191fb3e07 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024088 May 10 03:07:37.574810 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 20/40] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 10 03:07:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:07:37.584272 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-bd461c40-27ce-4c34-98f7-bf61710483a9 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:37.606205 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-bd461c40-27ce-4c34-98f7-bf61710483a9 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025547 May 10 03:07:37.606745 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 21/41] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 10 03:07:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:07:37.615700 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-618f9e22-02d3-4da6-8ea9-2212e85c7bc9 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:37.621276 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.wsgi [None req-618f9e22-02d3-4da6-8ea9-2212e85c7bc9 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-618f9e22-02d3-4da6-8ea9-2212e85c7bc9 admin admin] Request method failure captured: May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Accept: application/json May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Accept-Encoding: gzip, deflate May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Connection: keep-alive May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Content-Length: 0 May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Host: 10.222.0.55 May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Openstack-Api-Version: compute 2.90 May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Openstack-System-Scope: None May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: User-Agent: python-novaclient May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Auth-Token: gAAAAABiedb5JDQmZFtsdDrG0gwey7rqDpjMF75foD6somfe8y4CVbKSvp0oh0ygVIKuQeyZddvdA_QWaoYV8toCjfhGtLPQkgqEHxcNRGcIEzRqqlEb7YrYKPuJyT4cpl4l_ulkkcDiV_1ZA2SsoT2YJHSAAE3kEGjPBlknHnSEcJnppcpg-kY May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Domain-Id: None May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Domain-Name: None May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Identity-Status: Confirmed May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Is-Admin-Project: True May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Domain-Id: default May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Domain-Name: Default May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Name: admin May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Role: member,admin,reader May 10 03:07:37.624525 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Roles: member,admin,reader May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2e1554fd89594f468faedf42d5357b2f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2e1554fd89594f468faedf42d5357b2f"}]}] May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Tenant: admin May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Tenant-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Tenant-Name: admin May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User: admin May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Domain-Id: default May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Domain-Name: Default May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Id: d17410a7e6f74e8cbdb88de8e641816d May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Name: admin May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: method: > May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: exception: Flavor 42 could not be found. May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: action_args: {'id': '42'} May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:07:37.626038 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:37.626925 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:37.628030 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-618f9e22-02d3-4da6-8ea9-2212e85c7bc9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:07:37.629071 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-618f9e22-02d3-4da6-8ea9-2212e85c7bc9 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013759 May 10 03:07:37.629071 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 21/42] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 10 03:07:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 03:07:38.504585 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-bd461c40-27ce-4c34-98f7-bf61710483a9 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:38.505618 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-bd461c40-27ce-4c34-98f7-bf61710483a9 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 10 03:07:38.506013 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 22/43] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:38.691496 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-ed8d60fa-c2d4-46aa-9ff4-1f2c87314139 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:38.696716 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.wsgi [None req-ed8d60fa-c2d4-46aa-9ff4-1f2c87314139 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-ed8d60fa-c2d4-46aa-9ff4-1f2c87314139 admin admin] Request method failure captured: May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Accept: application/json May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Accept-Encoding: gzip, deflate May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Connection: keep-alive May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Content-Length: 0 May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Host: 10.222.0.55 May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Openstack-Api-Version: compute 2.90 May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Openstack-System-Scope: None May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: User-Agent: python-novaclient May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Auth-Token: gAAAAABiedb6Pc304NvWY5q7FTx3go-BfdJNfHMVZtvShFRaLyFc55roWOsbsUKVgL1Pj6qLwyE89eFA0oQnOA9ldgVTYsXZSeFOHdVr9UCAxn4YUMr9X9uZDmAxLj-z-IZsgpug1WsQscZyYW-Y3ZDJ1RncPQXjjHNpqkxJ7sQO57f0A5UB8a0 May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Domain-Id: None May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Domain-Name: None May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Identity-Status: Confirmed May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Is-Admin-Project: True May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Domain-Id: default May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Domain-Name: Default May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Name: admin May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Role: member,admin,reader May 10 03:07:38.698260 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Roles: member,admin,reader May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2e1554fd89594f468faedf42d5357b2f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2e1554fd89594f468faedf42d5357b2f"}]}] May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Tenant: admin May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Tenant-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Tenant-Name: admin May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User: admin May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Domain-Id: default May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Domain-Name: Default May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Id: d17410a7e6f74e8cbdb88de8e641816d May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Name: admin May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: method: > May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: exception: Flavor 84 could not be found. May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: action_args: {'id': '84'} May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:07:38.699756 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:38.700780 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:38.702243 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-ed8d60fa-c2d4-46aa-9ff4-1f2c87314139 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:07:38.703473 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-ed8d60fa-c2d4-46aa-9ff4-1f2c87314139 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059033 May 10 03:07:38.703473 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 22/44] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 10 03:07:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 03:07:38.709375 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-6a033535-91cd-40db-a0c6-ffc49243b869 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:38.722759 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-6a033535-91cd-40db-a0c6-ffc49243b869 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016991 May 10 03:07:38.723211 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 23/45] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 10 03:07:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:07:38.732814 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-857dcce1-2eec-41c0-93b9-62f5953d8d99 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:38.749655 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-857dcce1-2eec-41c0-93b9-62f5953d8d99 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020239 May 10 03:07:38.750176 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 23/46] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 10 03:07:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:07:38.759212 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-0f6d484e-5771-461a-a9cb-3fbcb37bb6d3 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:38.764376 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.wsgi [None req-0f6d484e-5771-461a-a9cb-3fbcb37bb6d3 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-0f6d484e-5771-461a-a9cb-3fbcb37bb6d3 admin admin] Request method failure captured: May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Accept: application/json May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Accept-Encoding: gzip, deflate May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Connection: keep-alive May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Content-Length: 0 May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Host: 10.222.0.55 May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Openstack-Api-Version: compute 2.90 May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Openstack-System-Scope: None May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: User-Agent: python-novaclient May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Auth-Token: gAAAAABiedb6Pc304NvWY5q7FTx3go-BfdJNfHMVZtvShFRaLyFc55roWOsbsUKVgL1Pj6qLwyE89eFA0oQnOA9ldgVTYsXZSeFOHdVr9UCAxn4YUMr9X9uZDmAxLj-z-IZsgpug1WsQscZyYW-Y3ZDJ1RncPQXjjHNpqkxJ7sQO57f0A5UB8a0 May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Domain-Id: None May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Domain-Name: None May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Identity-Status: Confirmed May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Is-Admin-Project: True May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Domain-Id: default May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Domain-Name: Default May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Name: admin May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Role: member,admin,reader May 10 03:07:38.765902 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Roles: member,admin,reader May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2e1554fd89594f468faedf42d5357b2f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2e1554fd89594f468faedf42d5357b2f"}]}] May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Tenant: admin May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Tenant-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Tenant-Name: admin May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User: admin May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Domain-Id: default May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Domain-Name: Default May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Id: d17410a7e6f74e8cbdb88de8e641816d May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Name: admin May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: method: > May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: exception: Flavor 84 could not be found. May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: action_args: {'id': '84'} May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:07:38.767233 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:38.768298 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:38.769743 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-0f6d484e-5771-461a-a9cb-3fbcb37bb6d3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:07:38.771024 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-0f6d484e-5771-461a-a9cb-3fbcb37bb6d3 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011547 May 10 03:07:38.771024 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 24/47] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 10 03:07:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 03:07:39.647646 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-857dcce1-2eec-41c0-93b9-62f5953d8d99 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:39.648636 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-857dcce1-2eec-41c0-93b9-62f5953d8d99 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 10 03:07:39.649057 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 24/48] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:07:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:39.835712 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-c8ab08ad-39ec-4262-b5fd-9ddca4a472cc admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:39.841945 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.wsgi [None req-c8ab08ad-39ec-4262-b5fd-9ddca4a472cc admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-c8ab08ad-39ec-4262-b5fd-9ddca4a472cc admin admin] Request method failure captured: May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Accept: application/json May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Accept-Encoding: gzip, deflate May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Connection: keep-alive May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Content-Length: 0 May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Host: 10.222.0.55 May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Openstack-Api-Version: compute 2.90 May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Openstack-System-Scope: None May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: User-Agent: python-novaclient May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Auth-Token: gAAAAABiedb76AR7G3qCkVclI_0jLOYG-blvY-ms2bNWMPkViamjlqVt8S3Ppo95laQlepr9ey2L_84uVHWe1Bbbro7-7FGSAS5ac-G96N_HKVSZHJg-WGGztGFdVdBBDeOIVUpqOE6N2b--txg8PAMtl_ddm6ITl_VRRXzIkCOejkRzBcrLy00 May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Domain-Id: None May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Domain-Name: None May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Identity-Status: Confirmed May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Is-Admin-Project: True May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Domain-Id: default May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Domain-Name: Default May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Project-Name: admin May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Role: member,admin,reader May 10 03:07:39.843447 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Roles: member,admin,reader May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2e1554fd89594f468faedf42d5357b2f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2e1554fd89594f468faedf42d5357b2f"}]}] May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Tenant: admin May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Tenant-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-Tenant-Name: admin May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User: admin May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Domain-Id: default May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Domain-Name: Default May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Id: d17410a7e6f74e8cbdb88de8e641816d May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: X-User-Name: admin May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: method: > May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: exception: Flavor 451 could not be found. May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: action_args: {'id': '451'} May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:07:39.845026 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:39.845918 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: ERROR nova.api.openstack.wsgi May 10 03:07:39.847079 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-c8ab08ad-39ec-4262-b5fd-9ddca4a472cc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:07:39.848322 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-c8ab08ad-39ec-4262-b5fd-9ddca4a472cc admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059170 May 10 03:07:39.848322 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 25/49] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 10 03:07:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 03:07:39.855293 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-5af46eb8-bf65-4354-89d3-b86b76dcb75d admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:39.868600 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-5af46eb8-bf65-4354-89d3-b86b76dcb75d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017490 May 10 03:07:39.869232 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 25/50] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 10 03:07:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:07:39.878387 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:39.892013 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017148 May 10 03:07:39.892540 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 26/51] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 10 03:07:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:07:39.902112 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-72663892-ae6b-4846-8567-682540f510af admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:39.907566 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.wsgi [None req-72663892-ae6b-4846-8567-682540f510af admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-72663892-ae6b-4846-8567-682540f510af admin admin] Request method failure captured: May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Accept: application/json May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Accept-Encoding: gzip, deflate May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Connection: keep-alive May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Content-Length: 0 May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Host: 10.222.0.55 May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Openstack-Api-Version: compute 2.90 May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Openstack-System-Scope: None May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: User-Agent: python-novaclient May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Auth-Token: gAAAAABiedb76AR7G3qCkVclI_0jLOYG-blvY-ms2bNWMPkViamjlqVt8S3Ppo95laQlepr9ey2L_84uVHWe1Bbbro7-7FGSAS5ac-G96N_HKVSZHJg-WGGztGFdVdBBDeOIVUpqOE6N2b--txg8PAMtl_ddm6ITl_VRRXzIkCOejkRzBcrLy00 May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Domain-Id: None May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Domain-Name: None May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Identity-Status: Confirmed May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Is-Admin-Project: True May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Domain-Id: default May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Domain-Name: Default May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Project-Name: admin May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Role: member,admin,reader May 10 03:07:39.909088 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Roles: member,admin,reader May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2e1554fd89594f468faedf42d5357b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2e1554fd89594f468faedf42d5357b2f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2e1554fd89594f468faedf42d5357b2f"}]}] May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Tenant: admin May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Tenant-Id: 2e1554fd89594f468faedf42d5357b2f May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-Tenant-Name: admin May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User: admin May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Domain-Id: default May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Domain-Name: Default May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Id: d17410a7e6f74e8cbdb88de8e641816d May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: X-User-Name: admin May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: method: > May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: exception: Flavor 451 could not be found. May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: action_args: {'id': '451'} May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:07:39.910710 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:39.911912 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: ERROR nova.api.openstack.wsgi May 10 03:07:39.913269 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-72663892-ae6b-4846-8567-682540f510af admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:07:39.914534 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-72663892-ae6b-4846-8567-682540f510af admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012337 May 10 03:07:39.914534 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 26/52] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 10 03:07:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 03:07:40.796054 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:40.797098 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 10 03:07:40.797493 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 27/53] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:07:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:40.988397 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-5ca9d7be-d320-48a3-b862-948278a60ed0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:41.006025 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-5ca9d7be-d320-48a3-b862-948278a60ed0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067123 May 10 03:07:41.006494 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 27/54] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 10 03:07:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:07:41.897486 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:41.898507 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 10 03:07:41.898909 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:42.085901 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-82e9612e-5614-4fee-b041-1827f8767baa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:42.103364 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-82e9612e-5614-4fee-b041-1827f8767baa admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068721 May 10 03:07:42.104003 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 28/56] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 10 03:07:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:07:42.983650 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:42.984676 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 10 03:07:42.985078 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 29/57] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:07:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:43.179053 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-e91b3e0b-207c-4db8-8897-6af0e873d1c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:43.195843 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-e91b3e0b-207c-4db8-8897-6af0e873d1c3 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067596 May 10 03:07:43.196313 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 29/58] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 10 03:07:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:07:44.084042 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:44.085078 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 10 03:07:44.085479 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 30/59] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:07:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:44.272585 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-639ca637-392d-4489-8156-d01959e01173 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:44.291568 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-639ca637-392d-4489-8156-d01959e01173 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068614 May 10 03:07:44.292128 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 30/60] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 10 03:07:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:07:45.184368 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:45.185394 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 10 03:07:45.185789 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 31/61] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:45.374887 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-f345308d-0752-40ba-8c96-247853380891 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:45.393996 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-f345308d-0752-40ba-8c96-247853380891 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069708 May 10 03:07:45.394524 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 31/62] 10.222.0.55 () {60 vars in 1202 bytes} [Tue May 10 03:07:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:08:47.390184 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:47.391176 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-3869a453-61c0-4ab2-b9e7-5b0272f76e58 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 10 03:08:47.391570 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 32/63] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 10 03:08:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:08:47.451014 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-9f894187-1d59-4186-b10f-b49d55987681 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:47.470309 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-9f894187-1d59-4186-b10f-b49d55987681 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072856 May 10 03:08:47.470836 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 32/64] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 10 03:08:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:08:47.493436 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-6e0b1e54-ca54-4483-978c-6420d2c94d62 admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:47.500993 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-6e0b1e54-ca54-4483-978c-6420d2c94d62 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012378 May 10 03:08:47.501516 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 33/65] 10.222.0.55 () {60 vars in 1282 bytes} [Tue May 10 03:08:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:47.512996 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-3a12c71f-f799-44c7-b158-b0ad8ddc7584 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:47.520723 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-3a12c71f-f799-44c7-b158-b0ad8ddc7584 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011160 May 10 03:08:47.521223 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 33/66] 10.222.0.55 () {60 vars in 1285 bytes} [Tue May 10 03:08:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:47.533029 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:47.540541 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011243 May 10 03:08:47.541085 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 34/67] 10.222.0.55 () {60 vars in 1285 bytes} [Tue May 10 03:08:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:08:47.551924 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-9b0dd589-ed39-45c9-a007-f1e51ca2e891 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:47.559292 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-9b0dd589-ed39-45c9-a007-f1e51ca2e891 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010870 May 10 03:08:47.559794 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 34/68] 10.222.0.55 () {60 vars in 1282 bytes} [Tue May 10 03:08:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:04.844922 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:04.845928 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 10 03:12:04.846330 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 35/69] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:12:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:05.134500 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-ce325840-3ee2-41dc-b9d7-b6393c17964e admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:05.135665 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:12:05.135665 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: warnings.warn(msg) May 10 03:12:05.136931 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-ce325840-3ee2-41dc-b9d7-b6393c17964e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:05.137376 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-ce325840-3ee2-41dc-b9d7-b6393c17964e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:05.138170 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-ce325840-3ee2-41dc-b9d7-b6393c17964e admin admin] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:05.138599 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-ce325840-3ee2-41dc-b9d7-b6393c17964e admin admin] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:05.172407 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-ce325840-3ee2-41dc-b9d7-b6393c17964e admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.166918 May 10 03:12:05.172997 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 35/70] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 10 03:12:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:12:06.081680 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:06.082686 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 10 03:12:06.083093 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 36/71] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:06.271436 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-554d64d1-52a7-473d-8d06-66d75f8749a0 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:06.273220 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:12:06.273220 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: warnings.warn(msg) May 10 03:12:06.274434 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-554d64d1-52a7-473d-8d06-66d75f8749a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:06.274876 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-554d64d1-52a7-473d-8d06-66d75f8749a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:06.275658 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-554d64d1-52a7-473d-8d06-66d75f8749a0 admin admin] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:06.276086 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-554d64d1-52a7-473d-8d06-66d75f8749a0 admin admin] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:06.294951 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-554d64d1-52a7-473d-8d06-66d75f8749a0 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.072893 May 10 03:12:06.295489 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 36/72] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 10 03:12:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:12:17.639781 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:17.640807 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 10 03:12:17.641204 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 37/73] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:17.834509 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-4f55e2a4-de58-4753-ad26-3b1b68fda8b5 admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:17.835859 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:12:17.835859 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: warnings.warn(msg) May 10 03:12:17.837072 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-4f55e2a4-de58-4753-ad26-3b1b68fda8b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:17.837519 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-4f55e2a4-de58-4753-ad26-3b1b68fda8b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:17.838306 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-4f55e2a4-de58-4753-ad26-3b1b68fda8b5 admin admin] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:17.838738 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-4f55e2a4-de58-4753-ad26-3b1b68fda8b5 admin admin] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:17.864298 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-4f55e2a4-de58-4753-ad26-3b1b68fda8b5 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080625 May 10 03:12:17.864804 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 37/74] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 10 03:12:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:12:18.756306 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: DEBUG nova.api.openstack.wsgi [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] Calling method '>' {{(pid=102773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:18.757498 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: INFO nova.api.openstack.requestlog [None req-b0f2a909-37a4-4938-b6d9-783a4722dc3d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001688 May 10 03:12:18.757956 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: [pid: 102773|app: 0|req: 38/75] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 10 03:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:18.948248 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG nova.api.openstack.wsgi [None req-000e820d-36f4-450e-8b4c-22c944e908ae admin admin] Calling method '>' {{(pid=102774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:18.949478 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:12:18.949478 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: warnings.warn(msg) May 10 03:12:18.950652 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-000e820d-36f4-450e-8b4c-22c944e908ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:18.951095 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-000e820d-36f4-450e-8b4c-22c944e908ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:18.951888 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-000e820d-36f4-450e-8b4c-22c944e908ae admin admin] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:18.952325 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: DEBUG oslo_concurrency.lockutils [None req-000e820d-36f4-450e-8b4c-22c944e908ae admin admin] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:18.973935 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: INFO nova.api.openstack.requestlog [None req-000e820d-36f4-450e-8b4c-22c944e908ae admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077496 May 10 03:12:18.974417 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: [pid: 102774|app: 0|req: 38/76] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 10 03:12:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:13:16.323020 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: Tue May 10 03:13:16 2022 - graceful shutdown triggered... May 10 03:13:16.322762 dv-cinder-830094-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 03:13:16.324046 dv-cinder-830094-4-iscsi devstack@n-api.service[102773]: Gracefully killing worker 1 (pid: 102773)... May 10 03:13:16.324749 dv-cinder-830094-4-iscsi devstack@n-api.service[102774]: Gracefully killing worker 2 (pid: 102774)... May 10 03:13:17.323789 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: worker 1 buried after 1 seconds May 10 03:13:17.323789 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: worker 2 buried after 1 seconds May 10 03:13:17.323789 dv-cinder-830094-4-iscsi devstack@n-api.service[102772]: goodbye to uWSGI. May 10 03:13:17.325458 dv-cinder-830094-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 03:13:17.326036 dv-cinder-830094-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 03:13:17.328644 dv-cinder-830094-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 03:13:17.343838 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 03:13:17 2022] *** May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: nodename: dv-cinder-830094-4-iscsi May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: machine: x86_64 May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: clock source: unix May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: pcre jit disabled May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: detected number of CPU cores: 4 May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: current working directory: / May 10 03:13:17.361740 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: detected binary path: /usr/bin/uwsgi-core May 10 03:13:17.362498 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: your processes number limit is 47680 May 10 03:13:17.362498 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: your memory page size is 4096 bytes May 10 03:13:17.362498 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: detected max file descriptor number: 2048 May 10 03:13:17.362498 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: lock engine: pthread robust mutexes May 10 03:13:17.362498 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: thunder lock: enabled May 10 03:13:17.362498 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 03:13:17.362498 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 03:13:17.412076 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: Python main interpreter initialized at 0x55f6850ee9c0 May 10 03:13:17.412076 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: python threads support enabled May 10 03:13:17.412076 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: your server socket listen backlog is limited to 100 connections May 10 03:13:17.412076 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: your mercy for graceful operations on workers is 90 seconds May 10 03:13:17.413445 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: mapped 403077 bytes (393 KB) for 2 cores May 10 03:13:17.413445 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: *** Operational MODE: preforking *** May 10 03:13:17.413930 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: *** uWSGI is running in multiple interpreter mode *** May 10 03:13:17.413930 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: spawned uWSGI master process (pid: 117098) May 10 03:13:17.414168 dv-cinder-830094-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 03:13:17.414725 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: spawned uWSGI worker 1 (pid: 117119, cores: 1) May 10 03:13:17.415281 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: spawned uWSGI worker 2 (pid: 117120, cores: 1) May 10 03:13:17.415610 dv-cinder-830094-4-iscsi devstack@n-api.service[117098]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 03:13:18.637270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 03:13:18.638539 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 03:13:19.439100 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:13:19.439100 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: from cryptography.utils import int_from_bytes May 10 03:13:19.439744 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:13:19.439744 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: from cryptography.utils import int_from_bytes May 10 03:13:19.454708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:13:19.454708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: from cryptography.utils import int_from_bytes May 10 03:13:19.455024 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:13:19.455024 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: from cryptography.utils import int_from_bytes May 10 03:13:21.890345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 03:13:21.890880 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 03:13:21.891145 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 03:13:21.891504 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 03:13:21.891759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 03:13:21.892149 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.892481 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.892833 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.893160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.893498 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.894781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.894781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.894781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.894781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.895142 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.895413 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.895667 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830094-4-iscsi {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.896000 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.896315 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.897248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.897805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.898118 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.898456 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.898773 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.899291 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.899748 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.900064 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.900404 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.900744 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.901071 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.901390 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.901722 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.902038 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.902369 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.902687 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.903101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830094-4-iscsi {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.903426 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.903746 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.904067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.904495 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.904844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.905164 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.905496 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.905827 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.906144 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.906479 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.906809 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.907394 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.907723 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.908035 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.908353 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.908684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.909018 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.909333 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.909648 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.909903 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.910220 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.910549 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.910880 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.911212 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.911468 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.911730 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.912056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.912417 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.912763 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.913079 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.913394 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.913708 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.914021 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.914339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.914653 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.914966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.915290 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.915615 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.915942 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.916255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.916582 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.917021 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.917278 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.917591 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.917935 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.918260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.918573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.918900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.919229 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.919541 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.919853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.920162 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.920486 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.920841 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.921154 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.921409 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.921715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.922034 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.922585 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.922740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.922966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.923277 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.923582 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.923896 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.924055 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 03:13:21.924502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.924768 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 03:13:21.924922 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.924922 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.925185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 03:13:21.925328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.925469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 03:13:21.925621 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.925770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 03:13:21.925905 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.926045 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.926179 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.926311 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.926450 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.926593 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.926726 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.926858 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.926990 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.927121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.927269 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.927441 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.927583 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.927724 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.927885 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.928165 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.928305 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.928501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.928606 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.928843 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.928955 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.929155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.929257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.929484 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.929585 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830094-4-iscsi {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.929795 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.929893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.930107 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.930209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.930415 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.930517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.930729 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.930821 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.931035 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.931131 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.931357 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.931462 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.931665 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.931764 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.931976 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.932173 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.932293 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.932486 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.932596 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.932820 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.932922 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.933133 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.933238 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.933472 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.933573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.933787 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.933882 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.934100 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.934206 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.934407 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.934500 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.934716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.934815 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.935021 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.935124 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.935345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.935445 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.935673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.935776 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830094-4-iscsi {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.935987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.936091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.936301 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.936473 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.936625 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.936814 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.936983 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.937140 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.937297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.937453 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.937601 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.937763 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.937935 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.938091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.938394 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.938556 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.938705 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.938872 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.939028 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.939182 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.939335 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.939489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.939636 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.939793 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.939977 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.940202 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.940202 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.940524 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.940762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.940925 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.940925 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.941220 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.941367 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.941512 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.941673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.941828 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.941976 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.942161 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.942161 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.942628 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.942901 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.943111 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.943271 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.944315 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.944789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.944954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.945115 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.945316 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.945479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.945647 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.945810 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.945810 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.946118 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.946265 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.946412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.946566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.946713 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.946881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.947029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.947177 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.947177 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.947482 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.947710 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.947859 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.948017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.948173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.948350 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.948502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.948677 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.948841 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.948996 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.949151 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.949308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.949454 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.949624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.949771 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.949916 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.950061 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.950223 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.950448 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.950609 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.950768 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.950916 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.951070 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.951216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.951372 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.951519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.951684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.951831 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.951977 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.952124 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.952285 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.952523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.952785 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.954609 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.955551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.955750 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.955914 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.956079 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.956230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.956385 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.956739 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.956905 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.957061 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.957372 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.957710 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.957877 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.958026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.958181 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.958328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.958489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.958645 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.958793 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.958984 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.959186 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.959848 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.960012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.960160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.960503 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.960753 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.960920 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.960920 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.961223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.961379 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.962034 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.962202 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.962359 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.962543 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.962798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.963049 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.963294 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.963459 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.963608 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.963769 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.963925 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.964073 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.964218 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.964364 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.964510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.964715 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.964888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.965065 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.965320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.965479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.965647 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.965794 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.965958 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.966116 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.966262 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.966415 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.966415 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.966771 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.966920 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.967067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.967222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.967378 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.967532 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.967697 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.967851 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.968004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.968152 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.968309 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.968455 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.968601 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.968784 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.968933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.969090 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.969245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.969398 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.969562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.969710 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.969857 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.970012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.970169 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.970324 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.970485 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.970640 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.970881 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.971046 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.971194 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.971342 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.971489 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.971651 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.971806 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.971968 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.972115 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.972270 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.972424 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.972579 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.972786 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.973019 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.973239 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.973493 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.973647 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.973794 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.973962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.974117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.974264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.974411 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.974564 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.974739 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.974968 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.975132 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.975307 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.975554 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.975706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.975854 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:13:21.976024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.976193 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.976340 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.976488 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.976643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.976868 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.977017 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.977164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.977318 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.977490 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.977732 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.977901 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.978058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.978222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.978370 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.978526 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.978683 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.978913 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.979064 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.979220 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.979368 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.979522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.979670 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.979827 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.979973 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.980127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.980296 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.980455 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.980617 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.980902 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.981056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.981202 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.981348 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.981494 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.981651 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.981807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.981962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.982109 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.982255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.982419 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.982419 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.982715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.982871 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.983042 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.983284 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.983504 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.983668 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.983929 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.984083 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.984231 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.984231 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.984537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.984537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.984863 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.985010 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.985157 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.985303 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.985705 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.985870 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.986039 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.986387 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.986541 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.986697 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.986859 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.987027 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.987182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.987330 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.987484 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.987630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.987786 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.987933 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.988088 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.988235 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.988381 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.988536 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.988726 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.988880 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.989039 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.989197 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.989346 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.989506 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.989654 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.989807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.989974 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.990703 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.990862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.991030 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.991192 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.991340 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.991487 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.991655 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.991811 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.991972 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.992127 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.992275 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.992421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.992567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.992766 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.992933 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.993090 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.993265 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.993453 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.993697 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.993876 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.994139 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.994303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.994460 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.994608 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.994817 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.994978 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.995135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.995282 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.995430 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.995575 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.995898 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.996085 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.996243 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.996392 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.996538 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.996721 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.996875 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.997037 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.997191 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.997340 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.997494 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.997641 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.997801 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.997950 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.998115 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.998264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.998410 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.998565 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.998727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.998875 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.999030 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.999185 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.999339 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.999494 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.999656 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.999813 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:21.999961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.000127 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.000275 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.000421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.000578 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.000765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.000937 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.001089 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.001252 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.001413 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.001561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.001708 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.001862 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.002017 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.002175 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.002332 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.002488 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.002635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.002790 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.002945 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.003102 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.003260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.003680 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.003906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.004057 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.004229 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.004396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.004559 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.004736 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.004898 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.005054 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.005202 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.005366 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.005529 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.005683 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.006980 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.007148 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.007312 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.007478 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.007652 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.007815 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.007981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.008135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.008289 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.008456 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.008456 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.008818 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.008985 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.009149 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.009304 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.009466 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.009620 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.009785 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.009939 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.010094 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.010257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.010410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.010563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.010725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.010886 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.010886 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.011268 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.011433 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.011591 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.011744 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.011916 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.012070 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.012237 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.012392 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.012555 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.012727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.012886 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.013051 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.013218 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.013392 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.013554 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.013708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.013890 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.014133 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.014308 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.014471 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.014626 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.014788 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.014949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.015104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.015265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.015419 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.015581 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.015745 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.015909 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.016082 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.016237 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.016402 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.016563 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.016790 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.016967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.017191 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.017351 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.017505 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.017674 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.017829 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.018343 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.018514 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.018692 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.018855 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.019021 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.019176 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.019379 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.019540 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.019694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.019847 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.020010 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.020173 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.020327 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.020480 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.020642 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.020846 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.021012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.021167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.021329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.021484 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.022292 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.022472 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.022653 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.022866 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.023023 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.023184 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.023340 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.023515 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.023671 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.023831 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.023985 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.024165 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.024397 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.024566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.024757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.024927 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.024927 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.025229 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.025390 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.025560 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.025560 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.025874 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.026027 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.026180 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.026355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.026513 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.026673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.026835 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.026997 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.027165 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.027402 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.027562 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.027716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.027881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.028034 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.028188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.028354 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.028516 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.028689 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.028860 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.029016 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.029177 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.029341 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.029503 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.029656 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.029817 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.029991 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.030159 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.030314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.030466 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.030626 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.030780 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.030946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.031116 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.031277 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.031431 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.031584 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.031737 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.031889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.032314 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.032468 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.032622 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.032810 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.032966 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.033139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.033303 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.033464 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.033625 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.033810 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.033978 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.034147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.034320 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.034563 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.034722 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.034884 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.035077 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.035249 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.035411 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.035573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.035735 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.035898 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.036052 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.036220 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.036394 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.036561 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.036764 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.036932 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.037136 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.037341 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.037588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.037782 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.037949 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.038105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.038273 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.038430 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.038591 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.038745 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.038922 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.039078 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.039245 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.039400 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.039553 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.039706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.039858 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.040026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.040194 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.040348 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.040510 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.040688 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.040853 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.041035 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.041190 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.041343 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.041497 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.041658 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.041813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.041986 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.042141 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.042294 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.042455 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.042613 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.042765 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.043008 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.043175 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.043329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.043490 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.043646 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.043799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.043963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.043963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.044265 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.044419 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.044597 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.044949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.045116 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.045282 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.045694 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.045862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.046019 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.046185 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.046356 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.046512 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.046675 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.046838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.046994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.047161 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.047325 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.047480 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.047654 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.047825 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.048273 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.048437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.048601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.048815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.048984 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.049148 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.049439 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.049601 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.049755 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.049912 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.050077 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.050253 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.050417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.050580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.050735 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.050735 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.051054 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.051209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.051372 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.051534 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.051697 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.051852 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.052158 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.052316 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.052481 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.052644 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.052876 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.053110 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.053279 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.053435 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.053598 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.053760 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.053923 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.054088 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.054251 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.054413 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.054593 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.054749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.054998 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.055176 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.055332 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.055486 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.056094 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.056277 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.056435 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.056605 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.056824 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.056981 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.057136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.057315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.057485 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.057647 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.057801 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.057964 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.058119 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.058273 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.058442 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.058605 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.058769 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.058925 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.059087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.059253 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.059429 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.059585 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.059747 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.059910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.059910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.060227 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.060390 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.060554 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.060736 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.060904 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.061068 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.061824 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.062007 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.062173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.062329 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.062494 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.062658 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.062813 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.062967 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.063120 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.063282 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.063444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.063610 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.063765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.063929 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.064092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.064255 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.064409 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.064579 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.064770 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.064935 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.065180 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.065349 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.065515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.065679 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.065834 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.065995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.066168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.066326 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.066489 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.066645 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.066798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.066960 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.066960 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.067254 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.067416 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.067578 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.067734 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.067895 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.068056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.068221 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.068386 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.069106 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.069264 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.069419 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.069606 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.069776 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.069941 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.070105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.070260 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.070260 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.070552 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.070719 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.070886 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.071041 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.071194 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.071348 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.071502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.071502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.071820 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.071985 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.072140 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.072300 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.072462 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.072631 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.072834 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.072991 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.073152 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.073314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.073479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.073640 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.073802 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.073802 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.074104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.074258 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.074421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.074584 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.074738 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.074902 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.075057 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.075298 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.075468 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.075625 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.075787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.075942 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.076097 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.076251 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.076419 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.076583 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.076782 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.076939 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.077111 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.077282 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.077437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.077598 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.077759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.077914 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.078066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.078231 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.078394 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.078548 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.078701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.078862 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.079017 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.079191 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.079355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.079509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.079662 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.079822 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.079984 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.080148 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.080303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.080465 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.080619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.080809 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.080981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.081143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.081314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.081477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.081676 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.081837 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.082021 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.082181 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.082343 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.082499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.082499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.082798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.082967 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.083132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.083304 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.083468 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.083630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.083784 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.083784 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.084748 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.084916 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.085083 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.085246 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.085510 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.085689 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.086382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.086382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.086719 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.086887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.087056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.087211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.087372 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.087534 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.087690 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.087852 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.088017 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.088182 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.088351 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.088514 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.088709 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.088889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.089045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.089199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.089352 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.089538 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.089672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.089771 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.089862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.089950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090047 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090136 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090238 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090327 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090598 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090695 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090783 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090868 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.090952 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091044 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091325 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091419 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091506 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091598 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091698 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091795 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.091903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092280 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092388 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092469 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092469 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092634 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092634 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092834 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092834 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.092982 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093134 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093213 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093381 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093460 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093710 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093856 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.093856 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094032 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094129 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094216 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094393 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094487 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094667 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094852 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.094997 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095101 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095189 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095366 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095366 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095578 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095681 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095769 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.095944 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096039 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096132 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096219 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096396 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096488 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096488 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096671 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096821 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.096921 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097008 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097289 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097383 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097477 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097571 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097666 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097760 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097852 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.097938 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098022 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098105 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098198 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098284 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098369 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098454 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098712 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.098967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.099055 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.099149 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.099236 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.099319 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.099403 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.099510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.099605 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.099877 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.100346 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.100446 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.100543 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.100630 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.100749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.100847 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.100934 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101019 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101205 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101306 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101579 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101852 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.101944 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.102029 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.102170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.102306 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.102397 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.102492 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.102628 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.102757 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.102853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.102927 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103013 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103093 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103166 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103250 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103342 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103599 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103702 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.103798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104020 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104127 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104392 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104392 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104548 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104849 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.104933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105110 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105210 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105381 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105472 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105820 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105906 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.105996 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106081 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106174 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106260 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106344 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106435 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106520 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106613 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106791 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106875 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.106973 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107162 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107356 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107443 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107535 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.107981 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108152 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108249 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108343 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108435 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108528 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108528 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108723 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108822 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.108917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109009 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109095 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109184 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109277 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109464 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109551 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109642 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109734 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109829 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.109916 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110000 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110084 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110253 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110346 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110432 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110529 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110623 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110708 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110806 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.110960 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111043 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111134 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111219 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111312 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111405 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111491 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111575 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111672 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111851 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.111944 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112037 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112123 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112210 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112282 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112363 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112442 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112525 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112608 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.112961 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113042 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113121 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113193 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113277 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113358 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113430 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113430 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113864 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.113955 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114047 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114133 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114216 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114395 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114486 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114577 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114663 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114845 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.114930 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.115020 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.115113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.115200 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.115293 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.115925 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.116076 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.116555 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.116700 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.116839 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.116978 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117096 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117096 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117308 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117398 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117497 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117599 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117688 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117773 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117857 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.117941 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118252 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118252 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118427 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118611 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118704 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118790 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118883 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.118982 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119070 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119353 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119440 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119530 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119709 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119802 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119895 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.119988 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.120091 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.120185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.120285 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.120386 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.120473 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.120558 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.120718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.120825 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.120921 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.121054 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.121159 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.121254 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.121349 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.121552 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.121658 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.121864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.121969 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.122179 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.122276 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.122511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.122700 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.122839 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.123019 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.123165 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.123351 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.123449 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.123677 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.123772 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.124000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.124103 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.124316 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.124413 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.124633 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.124812 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.124984 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.125087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.125291 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.125388 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.125598 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.125692 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.125907 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.126042 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.126215 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.126362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.126519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.126687 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.126845 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.127012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.127155 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.127325 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.127459 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.127652 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.127781 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.127980 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.128075 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.128294 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.128615 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.128735 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.128956 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.129065 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.129290 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.129384 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.129619 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.129720 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.129949 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.130045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.130269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.130363 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.130580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.130681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.130894 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.131042 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.132160 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.132267 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.132365 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.132511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.132618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.132780 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.132869 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.132972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.133115 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.133260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.133415 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.133575 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.133747 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.133892 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.134039 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.134203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.134344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.134514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.134653 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.134828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.134956 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.135151 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.135283 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.135451 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.135591 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.135758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.135900 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.136068 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.136217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.136376 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.136506 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.136704 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.136848 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.137015 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.137155 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.137325 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.137460 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.137637 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.137769 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.137945 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.138080 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.138255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.138382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.138564 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.138689 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.138871 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.138993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.139179 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.139302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.139517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.139625 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.139856 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.139951 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.140175 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.140270 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.140503 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.140613 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.140851 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.140972 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.141254 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.141362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.141465 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.141552 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.141780 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.141897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.142100 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.142195 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.142413 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.142508 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.142724 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.142830 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.143056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.143149 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.143368 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.143451 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.143684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.143903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.144001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.144238 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.144344 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.144558 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.144684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.144917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.145025 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.145235 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.145338 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.145541 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.145634 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.145848 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.145952 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.146155 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.146307 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.146478 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.146735 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.146922 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.147013 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.147135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.147494 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.147603 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.147809 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.147905 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.148118 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.148220 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.148425 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.148528 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.148758 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.148870 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.149070 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.149166 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.149377 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.149482 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.149683 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.149784 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.149991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.150094 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.150297 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.150463 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.150590 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.150720 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.150938 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.151036 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.151258 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.151360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.151575 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.151678 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.151889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.151982 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.152204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.152298 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.152516 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.152619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.152855 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.152953 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.153168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.153263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.153479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.153591 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.153796 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.153881 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.154105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 03:13:22.154188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.154434 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.154738 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.155158 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.155473 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.155790 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.156111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.156419 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.156765 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.157344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.157664 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.157986 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.158297 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.158629 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.158969 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.159298 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.159626 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.159936 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.160244 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.160550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.160885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.161206 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.161514 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.161818 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.162125 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.162908 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.163052 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.163366 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.163713 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.163979 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.164289 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.164593 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.164927 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.165232 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.165536 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.165839 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.166143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.166450 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.166753 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.167058 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.167361 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.167669 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.167972 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.168309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.168637 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.168975 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.169299 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.169612 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.169936 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.170246 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.170568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.170889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.171205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.171514 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.171844 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.172153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.172588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.172934 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.173206 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.173525 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.173841 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.174174 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.174487 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.174796 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.175119 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.175445 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.175764 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.176078 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.176390 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.176756 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.177075 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.177376 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.177691 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.178622 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.179018 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.179331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.179647 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.179809 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_db.sqlalchemy.engines [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:13:22.179977 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.180309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.180637 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.180990 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.181345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.181662 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.182008 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.182337 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.182653 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.182982 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.183272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:13:22.183515 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 03:13:22.207021 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_db.sqlalchemy.engines [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:13:22.247111 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.context [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3598736-4bcc-4a19-a7cb-e3b3f613b640(cell1) {{(pid=117120) load_cells /opt/stack/nova/nova/context.py:464}} May 10 03:13:22.251840 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:22.253491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:22.254316 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:22.257083 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:22.268814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_db.sqlalchemy.engines [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:13:22.269874 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_db.sqlalchemy.engines [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:13:22.272423 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.context [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3598736-4bcc-4a19-a7cb-e3b3f613b640(cell1) {{(pid=117119) load_cells /opt/stack/nova/nova/context.py:464}} May 10 03:13:22.276879 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:22.278450 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:22.279257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:22.281231 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:22.292924 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_db.sqlalchemy.engines [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:13:22.295030 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_db.sqlalchemy.engines [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:13:22.431893 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_db.sqlalchemy.engines [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:13:22.461100 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_db.sqlalchemy.engines [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:13:22.755961 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: WARNING keystonemiddleware.auth_token [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:13:22.763543 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: WARNING keystonemiddleware.auth_token [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:13:22.782762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: WARNING keystonemiddleware.auth_token [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:13:22.790827 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: WARNING keystonemiddleware.auth_token [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:13:23.120144 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: WARNING keystonemiddleware.auth_token [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:13:23.126457 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: WARNING keystonemiddleware.auth_token [None req-cce3e163-fcbb-46a5-b18c-d2f15dc0aa4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:13:23.132186 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6850ee9c0 pid: 117120 (default app) May 10 03:13:23.139423 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: WARNING keystonemiddleware.auth_token [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:13:23.145570 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: WARNING keystonemiddleware.auth_token [None req-9192558e-bfe0-468c-9bf8-a956b5ca0002 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:13:23.151568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6850ee9c0 pid: 117119 (default app) May 10 03:14:06.326901 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-960f50d9-60ee-4dab-afa6-71569627e3cc tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Action: 'create', calling method: .version_select at 0x7f14a6684280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1954196898"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:08.372603 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-960f50d9-60ee-4dab-afa6-71569627e3cc tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.328989 May 10 03:14:08.373388 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1154 bytes} [Tue May 10 03:14:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3333 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 03:14:08.386478 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6ef58c8d-25fd-488c-b34d-614677653de7 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a64d8280>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:08.473209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6ef58c8d-25fd-488c-b34d-614677653de7 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4" status: 200 len: 345 microversion: 2.1 time: 0.091331 May 10 03:14:08.473932 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 2/2] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:14:08 2022] GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:14:09.197374 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2139042350", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "networks": [{"uuid": "575784cb-76c0-40a2-87cd-ac1108d52bb1"}]}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:09.487015 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c8fbbcf9-a6fb-4af7-b2d6-457e62f6ac69 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a64d84c0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:09.513546 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] validate_networks() for [('575784cb-76c0-40a2-87cd-ac1108d52bb1', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:14:09.593112 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c8fbbcf9-a6fb-4af7-b2d6-457e62f6ac69 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4" status: 200 len: 346 microversion: 2.1 time: 0.110986 May 10 03:14:09.605594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 3/3] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:14:09 2022] GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 => generated 346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:14:09.610355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-981e4511-df16-481c-a871-a7ee0792c8c4 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Action: 'create', calling method: .version_select at 0x7f14a64d8940>, body: {"snapshot": {"volume_id": "9d6af355-e95d-4549-9872-96a1691e20e4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-402824150"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:09.954805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-981e4511-df16-481c-a871-a7ee0792c8c4 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.348867 May 10 03:14:09.955375 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 4/4] 10.222.0.55 () {60 vars in 1161 bytes} [Tue May 10 03:14:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:09.966284 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-96ac5c48-6203-47c0-9b75-d85d90452059 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a64e55e0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:10.069395 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-96ac5c48-6203-47c0-9b75-d85d90452059 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512" status: 200 len: 286 microversion: 2.1 time: 0.103999 May 10 03:14:10.070047 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 5/5] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 10 03:14:09 2022] GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512 => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:14:10.081303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5e47a600-82aa-4c5a-9c64-16875929c9d3 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a64d8e50>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:10.187638 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5e47a600-82aa-4c5a-9c64-16875929c9d3 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.110053 May 10 03:14:10.188675 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 6/6] 10.222.0.55 () {58 vars in 1139 bytes} [Tue May 10 03:14:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:10.213331 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-421ad32c-cae3-49fa-bc54-e6b626fd697a tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a64e5280>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:10.326124 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-421ad32c-cae3-49fa-bc54-e6b626fd697a tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512" status: 200 len: 286 microversion: 2.1 time: 0.125725 May 10 03:14:10.327584 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 7/7] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 10 03:14:10 2022] GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:11.047892 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:14:11.048333 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:14:11.050028 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:14:11.053989 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:14:11.054608 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:14:11.086993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:11.107009 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:11.109227 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:11.111320 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:11.193638 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Getting quotas for project 857b83406e874fcea2e81894d366f353. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:14:11.202888 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Getting quotas for user 6fb881a37e3a46538ddee06f510c7fa2 and project 857b83406e874fcea2e81894d366f353. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:14:11.250838 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:14:11.268171 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:14:11.339484 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9ab0069e-bb43-4515-8638-db8d3443c5e4 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a64e51f0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:11.396853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9ab0069e-bb43-4515-8638-db8d3443c5e4 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512" status: 200 len: 286 microversion: 2.1 time: 0.061210 May 10 03:14:11.398350 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 8/8] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 10 03:14:11 2022] GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:14:11.445560 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8cadbe98-7b24-4e27-b268-f3094594d3df tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.280005 May 10 03:14:11.449224 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 1/9] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:14:11.460267 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-28a3a90b-3352-4a93-bc1a-a5dcba7df1f4 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:11.492859 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-28a3a90b-3352-4a93-bc1a-a5dcba7df1f4 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:11.967858 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-28a3a90b-3352-4a93-bc1a-a5dcba7df1f4 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:12.007422 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-28a3a90b-3352-4a93-bc1a-a5dcba7df1f4 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1215 microversion: 2.1 time: 0.549906 May 10 03:14:12.008035 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 9/10] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:11 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1215 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:12.419331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3c101363-2030-45fb-a9d8-5e3df7ec44b6 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a648b280>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:12.549423 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3c101363-2030-45fb-a9d8-5e3df7ec44b6 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512" status: 200 len: 286 microversion: 2.1 time: 0.140816 May 10 03:14:12.550451 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 2/11] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 10 03:14:12 2022] GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:13.042929 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ea07e981-c2f0-4d88-b091-14722450be6d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:13.052910 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ea07e981-c2f0-4d88-b091-14722450be6d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:13.299788 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ea07e981-c2f0-4d88-b091-14722450be6d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:13.324966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ea07e981-c2f0-4d88-b091-14722450be6d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1215 microversion: 2.1 time: 0.294574 May 10 03:14:13.325653 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 10/12] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:13 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:13.562758 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cb441ff7-a85a-4647-9258-4b7abcfb8eb3 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a53eac10>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:13.617815 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-cb441ff7-a85a-4647-9258-4b7abcfb8eb3 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512" status: 200 len: 287 microversion: 2.1 time: 0.059865 May 10 03:14:13.623836 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 3/13] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 10 03:14:13 2022] GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:13.630989 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8631efb0-69e6-4319-8fb3-552578f87d79 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a64b55e0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:13.847865 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8631efb0-69e6-4319-8fb3-552578f87d79 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512" status: 202 len: 0 microversion: 2.1 time: 0.221325 May 10 03:14:13.848688 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 11/14] 10.222.0.55 () {58 vars in 1253 bytes} [Tue May 10 03:14:13 2022] DELETE /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:14:13.859960 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cf0f313c-6afb-46f5-be71-2dba280c3502 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a53f9310>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:13.916953 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-cf0f313c-6afb-46f5-be71-2dba280c3502 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512" status: 200 len: 286 microversion: 2.1 time: 0.061778 May 10 03:14:13.919028 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 4/15] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 10 03:14:13 2022] GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:14.351417 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-301b1250-1582-4d73-9294-5f492420049b tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:14.352804 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-301b1250-1582-4d73-9294-5f492420049b tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:14.361234 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-301b1250-1582-4d73-9294-5f492420049b tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:14.362104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-301b1250-1582-4d73-9294-5f492420049b tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:14.366065 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-301b1250-1582-4d73-9294-5f492420049b tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:14.366700 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-301b1250-1582-4d73-9294-5f492420049b tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:14.890077 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-301b1250-1582-4d73-9294-5f492420049b tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:14.906247 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-301b1250-1582-4d73-9294-5f492420049b tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1211 microversion: 2.1 time: 0.565512 May 10 03:14:14.907688 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 12/16] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:14 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1211 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:14.930777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e4b80328-8ec1-4b28-b989-4f7304e06cc2 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a53eadc0>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:14.981233 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-e4b80328-8ec1-4b28-b989-4f7304e06cc2 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] HTTP exception thrown: Snapshot 957ff9d6-51a3-4035-90f7-b841422b4512 could not be found. May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e4b80328-8ec1-4b28-b989-4f7304e06cc2 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Request method failure captured: May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512 HTTP/1.1 May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedh8xZA5rbEpH6shiuRw55-Y6FGnrZdY5mMtJ3_ZDxIEEXfMAs3_aCW0dpX_f4Pz74d_AQGl-d6YnNQ1JcPBU2zj6R9Kb5bGVa2T9RDoNieaiX5dZIVR1R-ZzDopAFQlQLLsrJvRuUEsqTE8aDnbC1iIg006hXWlJWvuYzANR2PZUD8 May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 19e49c6119e846f4868567b0e9ec5950 May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:14:14.986983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19e49c6119e846f4868567b0e9ec5950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19e49c6119e846f4868567b0e9ec5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19e49c6119e846f4868567b0e9ec5950", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19e49c6119e846f4868567b0e9ec5950"}]}] May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 19e49c6119e846f4868567b0e9ec5950 May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-VolumesSnapshotsTestJSON-1433828738-project May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 713b49f149db41c7a617834720661c37 May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1433828738-project May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Snapshot 957ff9d6-51a3-4035-90f7-b841422b4512 could not be found. May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '957ff9d6-51a3-4035-90f7-b841422b4512'} May 10 03:14:14.988279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 957ff9d6-51a3-4035-90f7-b841422b4512 could not be found. (HTTP 404) (Request-ID: req-4c22fcd8-e264-411c-b245-52157902c5a3) May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:14.989022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:14:14.990000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 957ff9d6-51a3-4035-90f7-b841422b4512 could not be found. May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 03:14:14.990887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 957ff9d6-51a3-4035-90f7-b841422b4512 could not be found. May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 957ff9d6-51a3-4035-90f7-b841422b4512 could not be found. May 10 03:14:14.991896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:14.996603 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e4b80328-8ec1-4b28-b989-4f7304e06cc2 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Returning 404 to user: Snapshot 957ff9d6-51a3-4035-90f7-b841422b4512 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:14:14.998155 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e4b80328-8ec1-4b28-b989-4f7304e06cc2 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512" status: 404 len: 111 microversion: 2.1 time: 0.072123 May 10 03:14:15.000493 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 5/17] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 10 03:14:14 2022] GET /compute/v2.1/os-snapshots/957ff9d6-51a3-4035-90f7-b841422b4512 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:14:15.009203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-16e0107d-9bb3-4c77-9c95-4aecd0cc5932 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a642d940>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:15.127510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-16e0107d-9bb3-4c77-9c95-4aecd0cc5932 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4" status: 202 len: 0 microversion: 2.1 time: 0.122802 May 10 03:14:15.128160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 13/18] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:14:15 2022] DELETE /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:14:15.152921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2260d950-0a3d-4ff1-ae1d-cf64245c73fe tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a6478ee0>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:15.237107 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2260d950-0a3d-4ff1-ae1d-cf64245c73fe tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4" status: 200 len: 345 microversion: 2.1 time: 0.103797 May 10 03:14:15.238233 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 6/19] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:14:15 2022] GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:15.925211 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c42c27de-667b-4f45-9797-54042e39699d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:15.926815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c42c27de-667b-4f45-9797-54042e39699d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:15.939198 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c42c27de-667b-4f45-9797-54042e39699d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:15.945564 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c42c27de-667b-4f45-9797-54042e39699d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:15.947033 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c42c27de-667b-4f45-9797-54042e39699d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:15.947515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c42c27de-667b-4f45-9797-54042e39699d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:16.251829 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-863ce56a-225a-42ca-a41c-47d0d7baaa77 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a53c14c0>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:16.263393 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c42c27de-667b-4f45-9797-54042e39699d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:16.294266 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c42c27de-667b-4f45-9797-54042e39699d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1273 microversion: 2.1 time: 0.371145 May 10 03:14:16.297936 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 14/20] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:15 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1273 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:16.325204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-863ce56a-225a-42ca-a41c-47d0d7baaa77 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] HTTP exception thrown: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-863ce56a-225a-42ca-a41c-47d0d7baaa77 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Request method failure captured: May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 HTTP/1.1 May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedh8xZA5rbEpH6shiuRw55-Y6FGnrZdY5mMtJ3_ZDxIEEXfMAs3_aCW0dpX_f4Pz74d_AQGl-d6YnNQ1JcPBU2zj6R9Kb5bGVa2T9RDoNieaiX5dZIVR1R-ZzDopAFQlQLLsrJvRuUEsqTE8aDnbC1iIg006hXWlJWvuYzANR2PZUD8 May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 19e49c6119e846f4868567b0e9ec5950 May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:14:16.327396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19e49c6119e846f4868567b0e9ec5950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19e49c6119e846f4868567b0e9ec5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19e49c6119e846f4868567b0e9ec5950", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19e49c6119e846f4868567b0e9ec5950"}]}] May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 19e49c6119e846f4868567b0e9ec5950 May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-VolumesSnapshotsTestJSON-1433828738-project May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 713b49f149db41c7a617834720661c37 May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1433828738-project May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '9d6af355-e95d-4549-9872-96a1691e20e4'} May 10 03:14:16.328477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. (HTTP 404) (Request-ID: req-d80cef14-082d-4e00-9dbb-13d42fdc5481) May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:16.329127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:14:16.329991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 03:14:16.330889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.331749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.334411 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-863ce56a-225a-42ca-a41c-47d0d7baaa77 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Returning 404 to user: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:14:16.335468 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-863ce56a-225a-42ca-a41c-47d0d7baaa77 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4" status: 404 len: 109 microversion: 2.1 time: 0.089529 May 10 03:14:16.336199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 7/21] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:14:16 2022] GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:14:16.349562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8c89693d-a19b-4ee6-b6df-aaeb2184a2ff tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a6444550>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:16.418708 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-8c89693d-a19b-4ee6-b6df-aaeb2184a2ff tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] HTTP exception thrown: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8c89693d-a19b-4ee6-b6df-aaeb2184a2ff tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Request method failure captured: May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: DELETE /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 HTTP/1.1 May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedh8xZA5rbEpH6shiuRw55-Y6FGnrZdY5mMtJ3_ZDxIEEXfMAs3_aCW0dpX_f4Pz74d_AQGl-d6YnNQ1JcPBU2zj6R9Kb5bGVa2T9RDoNieaiX5dZIVR1R-ZzDopAFQlQLLsrJvRuUEsqTE8aDnbC1iIg006hXWlJWvuYzANR2PZUD8 May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 19e49c6119e846f4868567b0e9ec5950 May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:14:16.422981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19e49c6119e846f4868567b0e9ec5950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19e49c6119e846f4868567b0e9ec5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19e49c6119e846f4868567b0e9ec5950", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19e49c6119e846f4868567b0e9ec5950"}]}] May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 19e49c6119e846f4868567b0e9ec5950 May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-VolumesSnapshotsTestJSON-1433828738-project May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 713b49f149db41c7a617834720661c37 May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1433828738-project May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '9d6af355-e95d-4549-9872-96a1691e20e4'} May 10 03:14:16.424270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. (HTTP 404) (Request-ID: req-374ff3e2-786a-40ba-8579-d96cc2b961fc) May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:16.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:14:16.426650 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 03:14:16.428183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.429299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:14:16.432246 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8c89693d-a19b-4ee6-b6df-aaeb2184a2ff tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Returning 404 to user: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:14:16.434698 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8c89693d-a19b-4ee6-b6df-aaeb2184a2ff tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4" status: 404 len: 109 microversion: 2.1 time: 0.091608 May 10 03:14:16.435488 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 15/22] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:14:16 2022] DELETE /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:14:16.444049 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4180f56e-90da-4bd5-bb4b-9401441839c6 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Calling method '.version_select at 0x7f14a5361280>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:16.510554 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-4180f56e-90da-4bd5-bb4b-9401441839c6 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] HTTP exception thrown: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4180f56e-90da-4bd5-bb4b-9401441839c6 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Request method failure captured: May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 HTTP/1.1 May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedh8xZA5rbEpH6shiuRw55-Y6FGnrZdY5mMtJ3_ZDxIEEXfMAs3_aCW0dpX_f4Pz74d_AQGl-d6YnNQ1JcPBU2zj6R9Kb5bGVa2T9RDoNieaiX5dZIVR1R-ZzDopAFQlQLLsrJvRuUEsqTE8aDnbC1iIg006hXWlJWvuYzANR2PZUD8 May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 19e49c6119e846f4868567b0e9ec5950 May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:14:16.513527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19e49c6119e846f4868567b0e9ec5950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19e49c6119e846f4868567b0e9ec5950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19e49c6119e846f4868567b0e9ec5950", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19e49c6119e846f4868567b0e9ec5950"}]}] May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 19e49c6119e846f4868567b0e9ec5950 May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1433828738 May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-VolumesSnapshotsTestJSON-1433828738-project May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 713b49f149db41c7a617834720661c37 May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1433828738-project May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '9d6af355-e95d-4549-9872-96a1691e20e4'} May 10 03:14:16.515499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. (HTTP 404) (Request-ID: req-265f1a26-7e5b-4e6a-ad7f-af61c90dc3f8) May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:16.516146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:14:16.517056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 03:14:16.517961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. May 10 03:14:16.521017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:14:16.525726 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4180f56e-90da-4bd5-bb4b-9401441839c6 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] Returning 404 to user: Volume 9d6af355-e95d-4549-9872-96a1691e20e4 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:14:16.526821 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4180f56e-90da-4bd5-bb4b-9401441839c6 tempest-VolumesSnapshotsTestJSON-1433828738 tempest-VolumesSnapshotsTestJSON-1433828738-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4" status: 404 len: 109 microversion: 2.1 time: 0.086836 May 10 03:14:16.527398 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 8/23] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:14:16 2022] GET /compute/v2.1/os-volumes/9d6af355-e95d-4549-9872-96a1691e20e4 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:14:17.316762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5115dd4a-b412-41dc-8f1b-877e784a8eca tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:17.317606 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5115dd4a-b412-41dc-8f1b-877e784a8eca tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:17.338204 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5115dd4a-b412-41dc-8f1b-877e784a8eca tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:17.338880 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5115dd4a-b412-41dc-8f1b-877e784a8eca tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:17.340255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5115dd4a-b412-41dc-8f1b-877e784a8eca tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:17.340986 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5115dd4a-b412-41dc-8f1b-877e784a8eca tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:17.822233 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5115dd4a-b412-41dc-8f1b-877e784a8eca tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:17.837824 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5115dd4a-b412-41dc-8f1b-877e784a8eca tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1273 microversion: 2.1 time: 0.526817 May 10 03:14:17.843551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 16/24] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:17 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1273 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:18.859624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b0db133d-0545-4817-ae11-bbea427712e8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:18.860249 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b0db133d-0545-4817-ae11-bbea427712e8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:18.904881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b0db133d-0545-4817-ae11-bbea427712e8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:18.907530 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b0db133d-0545-4817-ae11-bbea427712e8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:18.911442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b0db133d-0545-4817-ae11-bbea427712e8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:18.912440 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b0db133d-0545-4817-ae11-bbea427712e8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:19.585718 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b0db133d-0545-4817-ae11-bbea427712e8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:19.634938 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b0db133d-0545-4817-ae11-bbea427712e8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1273 microversion: 2.1 time: 0.778723 May 10 03:14:19.638297 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 9/25] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:18 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1273 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:20.657322 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d4067e70-e204-4353-8b2d-61242a391070 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:20.658569 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d4067e70-e204-4353-8b2d-61242a391070 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:20.677635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4067e70-e204-4353-8b2d-61242a391070 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:20.678338 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4067e70-e204-4353-8b2d-61242a391070 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:20.679333 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4067e70-e204-4353-8b2d-61242a391070 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:20.681395 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4067e70-e204-4353-8b2d-61242a391070 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:21.770994 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d4067e70-e204-4353-8b2d-61242a391070 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:21.791492 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d4067e70-e204-4353-8b2d-61242a391070 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 1.139496 May 10 03:14:21.792097 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 17/26] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:20 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:22.822671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-27d27cf3-f74a-458e-bef4-1afca1a4de3a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:22.824665 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-27d27cf3-f74a-458e-bef4-1afca1a4de3a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:22.836342 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-27d27cf3-f74a-458e-bef4-1afca1a4de3a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:22.837053 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-27d27cf3-f74a-458e-bef4-1afca1a4de3a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:22.838327 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-27d27cf3-f74a-458e-bef4-1afca1a4de3a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:22.841420 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-27d27cf3-f74a-458e-bef4-1afca1a4de3a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:24.430340 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c3985e03-009b-42fe-87d3-cbc84ed9a9b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'create', calling method: .version_select at 0x7f14a6403a60>, body: {"keypair": {"name": "tempest-keypair-1764817963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe+WdALmX/EJ0JsND8rUR82LBBnBsX5fN8mzKejkUWZs7SQBmsb+uldhZ02lWT6Lt6kIdVQ9POUV/WkJmA50WiDscvr5qMbeFpQSQD5s3je4/G4CyApuvX4T+85Klysmw=="}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:24.652238 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-c3985e03-009b-42fe-87d3-cbc84ed9a9b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Getting quotas for project f4149fee898c44c180ae1de15ac9d9da. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:14:24.698695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-c3985e03-009b-42fe-87d3-cbc84ed9a9b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Getting quotas for user a8a3337faba84d0aa85df4121ffb5cd2 and project f4149fee898c44c180ae1de15ac9d9da. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:14:24.846128 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c3985e03-009b-42fe-87d3-cbc84ed9a9b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.734010 May 10 03:14:24.850530 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 18/27] 10.222.0.55 () {62 vars in 1199 bytes} [Tue May 10 03:14:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 739 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 10 03:14:24.859880 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-63a5f435-1d42-46b9-bf94-cedf70967479 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a6341940>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:24.958066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-63a5f435-1d42-46b9-bf94-cedf70967479 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/3769c0d4-4400-4f02-9c71-1befb419a960" status: 200 len: 350 microversion: 2.1 time: 0.105171 May 10 03:14:24.959007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 19/28] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:14:24 2022] GET /compute/v2.1/os-volumes/3769c0d4-4400-4f02-9c71-1befb419a960 => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:25.852981 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-27d27cf3-f74a-458e-bef4-1afca1a4de3a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:25.870246 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-27d27cf3-f74a-458e-bef4-1afca1a4de3a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 3.046904 May 10 03:14:25.876417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 10/29] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:22 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 3061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:26.390972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c1c35bb3-e516-42ba-9ff9-fdbd49a02e40 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: .version_select at 0x7f14a6341ee0>, body: {"keypair": {"name": "tempest-keypair-1094492101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3gwstFCUiHI9kiI7g83LdtvWl6I8oFHeOv8TljsMZ6oxL5j5h+9Tn+kFGqe7ZvDRLHPUymo/V7CqifCXOtQAnXZYYuJ6wdH1E/Rg4ZH6lYapctWb4eNVUALJYpmPkELQ=="}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:26.465892 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-c1c35bb3-e516-42ba-9ff9-fdbd49a02e40 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:14:26.478692 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-c1c35bb3-e516-42ba-9ff9-fdbd49a02e40 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for user 775d3d61ab8d42c3a528028592ad71f8 and project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:14:26.535416 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c1c35bb3-e516-42ba-9ff9-fdbd49a02e40 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.773236 May 10 03:14:26.536107 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 20/30] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:14:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:26.905104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-124b2180-48aa-48c0-aec2-9fe8a228cbd3 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:26.905719 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-124b2180-48aa-48c0-aec2-9fe8a228cbd3 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:26.933975 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-124b2180-48aa-48c0-aec2-9fe8a228cbd3 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:26.934458 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-124b2180-48aa-48c0-aec2-9fe8a228cbd3 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:26.947040 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-124b2180-48aa-48c0-aec2-9fe8a228cbd3 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:26.949549 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-124b2180-48aa-48c0-aec2-9fe8a228cbd3 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:27.204439 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-127d851d-b1ad-4c54-8578-d625fd6129ab tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a6341160>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:27.370058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-127d851d-b1ad-4c54-8578-d625fd6129ab tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9265e2b8-2e47-4188-b721-e6ece195913a" status: 200 len: 350 microversion: 2.1 time: 0.169499 May 10 03:14:27.370921 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 21/31] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:14:27 2022] GET /compute/v2.1/os-volumes/9265e2b8-2e47-4188-b721-e6ece195913a => generated 350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:27.659385 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-124b2180-48aa-48c0-aec2-9fe8a228cbd3 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:27.668549 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-124b2180-48aa-48c0-aec2-9fe8a228cbd3 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 0.780631 May 10 03:14:27.692222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 11/32] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:26 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:28.375217 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-304e396c-3239-4ed9-b48f-fdb5b366ffef tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'create', calling method: .version_select at 0x7f14a5af1310>, body: {"keypair": {"name": "tempest-keypair-66328474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJK1U26FZ8UDJsdcpCfn5GG2TwLTXtxjXgpjvPn996KtRKZRr9KNmNs4ogKqXuXKbyw9HzLJGRZwtN0sliaw6budbn12pEw6TAm00GACINMH9OG4icvCZRQdW4SmDo9qQw=="}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:28.449669 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-304e396c-3239-4ed9-b48f-fdb5b366ffef tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Getting quotas for project 5d958793e0ab4e6f8d2f296dcf6186f5. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:14:28.465232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-304e396c-3239-4ed9-b48f-fdb5b366ffef tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Getting quotas for user 314a5e1a357c4a73a33391b6f25a44c6 and project 5d958793e0ab4e6f8d2f296dcf6186f5. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:14:28.525237 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-304e396c-3239-4ed9-b48f-fdb5b366ffef tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.798521 May 10 03:14:28.535475 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 22/33] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:14:27 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:28.709757 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-72ff224e-83ca-4108-ae3f-6049196be1db tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:28.710433 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-72ff224e-83ca-4108-ae3f-6049196be1db tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:28.767983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-72ff224e-83ca-4108-ae3f-6049196be1db tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:28.797641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-72ff224e-83ca-4108-ae3f-6049196be1db tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:28.807392 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-72ff224e-83ca-4108-ae3f-6049196be1db tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:28.810899 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-72ff224e-83ca-4108-ae3f-6049196be1db tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:29.407890 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6f3dda7c-facd-4821-98dc-3056ea31d0ea tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a5af5820>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:29.583492 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6f3dda7c-facd-4821-98dc-3056ea31d0ea tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5791cb26-a029-4437-bfba-a8fdd10f7e77" status: 200 len: 351 microversion: 2.1 time: 0.180702 May 10 03:14:29.584532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 23/34] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:14:29 2022] GET /compute/v2.1/os-volumes/5791cb26-a029-4437-bfba-a8fdd10f7e77 => generated 351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:29.598148 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-231a2696-e6b7-43c1-b759-657a504b2d8b tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a5af1d30>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:29.889954 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-72ff224e-83ca-4108-ae3f-6049196be1db tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:29.905596 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-72ff224e-83ca-4108-ae3f-6049196be1db tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 1.201850 May 10 03:14:29.908703 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 12/35] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:28 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:29.964413 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-231a2696-e6b7-43c1-b759-657a504b2d8b tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.372260 May 10 03:14:29.965267 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 24/36] 10.222.0.55 () {58 vars in 1133 bytes} [Tue May 10 03:14:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:29.980237 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5e5bac2d-01d1-4685-bcca-9e23960bde7d tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a5af10d0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:30.179764 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-990d8ffd-f77e-4358-997c-fe2759401e12 req-bdda17c4-c25d-4eac-9203-61fecdd61e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "364eff63-27a1-4e99-bb61-81ac36f72973", "tag": "1250bf8e-004a-44ae-a5a9-5013188a9085"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:30.201853 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-990d8ffd-f77e-4358-997c-fe2759401e12 req-bdda17c4-c25d-4eac-9203-61fecdd61e84 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:30.202751 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-990d8ffd-f77e-4358-997c-fe2759401e12 req-bdda17c4-c25d-4eac-9203-61fecdd61e84 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:30.278204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-990d8ffd-f77e-4358-997c-fe2759401e12 req-bdda17c4-c25d-4eac-9203-61fecdd61e84 service nova] Creating event network-changed:1250bf8e-004a-44ae-a5a9-5013188a9085 for instance 364eff63-27a1-4e99-bb61-81ac36f72973 on hv-cinder-83009 May 10 03:14:30.281093 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-990d8ffd-f77e-4358-997c-fe2759401e12 req-bdda17c4-c25d-4eac-9203-61fecdd61e84 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 03:14:30.283325 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d1ae55b0-188f-4932-848a-1b5efdd0481d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:30.283999 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d1ae55b0-188f-4932-848a-1b5efdd0481d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:30.286020 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d1ae55b0-188f-4932-848a-1b5efdd0481d None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:30.287171 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d1ae55b0-188f-4932-848a-1b5efdd0481d None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:30.301554 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.compute.rpcapi [None req-d1ae55b0-188f-4932-848a-1b5efdd0481d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 03:14:30.303648 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d1ae55b0-188f-4932-848a-1b5efdd0481d None None] Releasing lock "compute-rpcapi-router" {{(pid=117119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 03:14:30.317988 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5e5bac2d-01d1-4685-bcca-9e23960bde7d tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.342537 May 10 03:14:30.319669 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 25/37] 10.222.0.55 () {58 vars in 1148 bytes} [Tue May 10 03:14:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:30.338017 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5d100c4d-ff20-4ea4-8885-e27c6f0d44e0 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a63419d0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:30.359824 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d1ae55b0-188f-4932-848a-1b5efdd0481d None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.447900 May 10 03:14:30.361005 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 13/38] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:30.536795 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5d100c4d-ff20-4ea4-8885-e27c6f0d44e0 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.206356 May 10 03:14:30.538082 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 26/39] 10.222.0.55 () {58 vars in 1133 bytes} [Tue May 10 03:14:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:30.557904 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7fa1650d-7f95-4694-8d5d-b5284853f752 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a52ceb80>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:30.847439 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7fa1650d-7f95-4694-8d5d-b5284853f752 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.298075 May 10 03:14:30.850621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 14/40] 10.222.0.55 () {58 vars in 1166 bytes} [Tue May 10 03:14:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:30.862304 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1443fa6f-532e-4176-8a45-dc61f23a0608 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a6341d30>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:30.925641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8e1320b5-2cab-41b6-97de-8d493a8b56e9 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:30.927274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8e1320b5-2cab-41b6-97de-8d493a8b56e9 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:30.940469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8e1320b5-2cab-41b6-97de-8d493a8b56e9 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:30.949866 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8e1320b5-2cab-41b6-97de-8d493a8b56e9 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:30.952208 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8e1320b5-2cab-41b6-97de-8d493a8b56e9 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:30.952820 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8e1320b5-2cab-41b6-97de-8d493a8b56e9 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:31.094889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1443fa6f-532e-4176-8a45-dc61f23a0608 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.236663 May 10 03:14:31.096369 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 27/41] 10.222.0.55 () {58 vars in 1169 bytes} [Tue May 10 03:14:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:31.108635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a9be7b34-c62f-4e84-90ad-a2fa0f525b9e tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a5af5040>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:31.411493 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a9be7b34-c62f-4e84-90ad-a2fa0f525b9e tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.307575 May 10 03:14:31.413195 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 28/42] 10.222.0.55 () {58 vars in 1154 bytes} [Tue May 10 03:14:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:31.424495 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-94803bf5-834b-4631-ad97-4cb68a257f5e tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a5af2040>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:31.648743 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-94803bf5-834b-4631-ad97-4cb68a257f5e tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.228514 May 10 03:14:31.650568 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 29/43] 10.222.0.55 () {58 vars in 1187 bytes} [Tue May 10 03:14:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:31.664732 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-de4f37f0-dafc-45af-bdf9-703b6cb2f498 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] Calling method '.version_select at 0x7f14a5af5ca0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:31.857589 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-de4f37f0-dafc-45af-bdf9-703b6cb2f498 tempest-VolumesTestJSON-1602182744 tempest-VolumesTestJSON-1602182744-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.196733 May 10 03:14:31.858831 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 30/44] 10.222.0.55 () {58 vars in 1154 bytes} [Tue May 10 03:14:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:32.019207 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-304388973", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:32.275038 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.network.neutron [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] validate_networks() for [('73cc213e-781c-42c1-8c05-7293b0a3f3ad', None, None, None, None, None)] {{(pid=117120) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:14:32.427637 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8e1320b5-2cab-41b6-97de-8d493a8b56e9 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:32.436478 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8e1320b5-2cab-41b6-97de-8d493a8b56e9 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 1.515170 May 10 03:14:32.445886 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 15/45] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:30 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:33.460151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f4e69fe3-5dc3-49f7-a501-de68d67f7b24 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:33.461830 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f4e69fe3-5dc3-49f7-a501-de68d67f7b24 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:33.486958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4e69fe3-5dc3-49f7-a501-de68d67f7b24 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:33.488870 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4e69fe3-5dc3-49f7-a501-de68d67f7b24 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:33.489869 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4e69fe3-5dc3-49f7-a501-de68d67f7b24 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:33.490595 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4e69fe3-5dc3-49f7-a501-de68d67f7b24 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:34.013490 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f4e69fe3-5dc3-49f7-a501-de68d67f7b24 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:34.023305 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f4e69fe3-5dc3-49f7-a501-de68d67f7b24 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 0.571407 May 10 03:14:34.023934 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 16/46] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:33 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:34.203737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Flavor limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:14:34.204252 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Image limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:14:34.204706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Flavor pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:14:34.205104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Image pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:14:34.205529 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:14:34.224088 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:34.224549 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:34.225406 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:34.226032 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:34.276509 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Getting quotas for project d2279255bed8483c82ba27a2451313fc. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:14:34.290292 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Getting quotas for user 6dac5d7569d4402ca9c910ea8862b5d9 and project d2279255bed8483c82ba27a2451313fc. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:14:34.311615 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Going to run 1 instances... {{(pid=117120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:14:34.314480 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:14:34.452679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-81fadb94-09d6-45f5-85eb-943091a938aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.556984 May 10 03:14:34.453738 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 31/47] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:14:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:14:34.465134 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-41d02d17-5d95-4961-851f-e06278abefdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:34.465824 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-41d02d17-5d95-4961-851f-e06278abefdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:34.834032 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-41d02d17-5d95-4961-851f-e06278abefdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:34.856395 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-41d02d17-5d95-4961-851f-e06278abefdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1221 microversion: 2.1 time: 0.395402 May 10 03:14:34.858384 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 17/48] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:34 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1221 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:35.007995 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-863662168", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:35.042983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ebe88586-22d5-4b93-9d4b-08d1d6d85d84 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:35.044432 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ebe88586-22d5-4b93-9d4b-08d1d6d85d84 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:35.093938 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ebe88586-22d5-4b93-9d4b-08d1d6d85d84 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:35.094473 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ebe88586-22d5-4b93-9d4b-08d1d6d85d84 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:35.095532 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ebe88586-22d5-4b93-9d4b-08d1d6d85d84 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:35.096167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ebe88586-22d5-4b93-9d4b-08d1d6d85d84 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:35.114216 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.network.neutron [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] validate_networks() for [('73cc213e-781c-42c1-8c05-7293b0a3f3ad', None, None, None, None, None)] {{(pid=117120) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:14:35.746293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ebe88586-22d5-4b93-9d4b-08d1d6d85d84 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:35.763036 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ebe88586-22d5-4b93-9d4b-08d1d6d85d84 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 0.725135 May 10 03:14:35.763745 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 18/49] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:35 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:35.799434 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1597414411", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b607388-5cb4-41a1-8154-ba2917605d5c"}], "security_groups": [{"name": "tempest-securitygroup--1393009039"}], "key_name": "tempest-keypair-1764817963", "user_data": "}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:36.120320 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] validate_networks() for [('2b607388-5cb4-41a1-8154-ba2917605d5c', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:14:36.755691 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Flavor limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:14:36.756247 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Image limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:14:36.756568 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Flavor pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:14:36.757199 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Image pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:14:36.757614 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:14:36.780501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:36.780987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:36.787868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:36.788330 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:36.865944 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Getting quotas for project d2279255bed8483c82ba27a2451313fc. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:14:36.878765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Getting quotas for user 6dac5d7569d4402ca9c910ea8862b5d9 and project d2279255bed8483c82ba27a2451313fc. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:14:36.912823 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Going to run 1 instances... {{(pid=117120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:14:36.915941 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:14:37.109186 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-cbe783c3-6016-4971-86b3-9101850c05d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.116732 May 10 03:14:37.109931 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 32/50] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:14:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:14:37.134813 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3f6da86d-d566-4f3b-8580-bc19971de67e tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:37.148417 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3f6da86d-d566-4f3b-8580-bc19971de67e tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:37.168718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3f6da86d-d566-4f3b-8580-bc19971de67e tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:37.176312 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3f6da86d-d566-4f3b-8580-bc19971de67e tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:37.180794 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3f6da86d-d566-4f3b-8580-bc19971de67e tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:37.181442 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3f6da86d-d566-4f3b-8580-bc19971de67e tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:37.731911 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3f6da86d-d566-4f3b-8580-bc19971de67e tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:37.749424 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3f6da86d-d566-4f3b-8580-bc19971de67e tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 0.621679 May 10 03:14:37.753058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 33/51] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:37 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:37.809513 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1360382680", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20b0c49b-98e0-4d73-bdea-8b46faafc116"}], "security_groups": [{"name": "tempest-securitygroup--2022660669"}], "key_name": "tempest-keypair-1094492101", "user_data": "}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:38.100258 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:14:38.100800 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:14:38.101150 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:14:38.101811 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:14:38.102235 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:14:38.121104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:38.122121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:38.123319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:38.123941 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:38.165731 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Getting quotas for project f4149fee898c44c180ae1de15ac9d9da. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:14:38.176849 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Getting quotas for user a8a3337faba84d0aa85df4121ffb5cd2 and project f4149fee898c44c180ae1de15ac9d9da. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:14:38.198423 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:14:38.200767 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:14:38.266795 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.network.neutron [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] validate_networks() for [('20b0c49b-98e0-4d73-bdea-8b46faafc116', None, None, None, None, None)] {{(pid=117120) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:14:38.299166 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-da7d5dd5-1f69-4a13-b3ea-f4de0e5375d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.504296 May 10 03:14:38.309184 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 19/52] 10.222.0.55 () {62 vars in 1187 bytes} [Tue May 10 03:14:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2522 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 03:14:38.320231 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b06ecbf0-b374-4679-b902-a5c3e01dce66 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:38.326601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b06ecbf0-b374-4679-b902-a5c3e01dce66 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:38.360966 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b06ecbf0-b374-4679-b902-a5c3e01dce66 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:38.361426 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b06ecbf0-b374-4679-b902-a5c3e01dce66 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:38.362212 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b06ecbf0-b374-4679-b902-a5c3e01dce66 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:38.375587 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b06ecbf0-b374-4679-b902-a5c3e01dce66 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:38.605941 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b06ecbf0-b374-4679-b902-a5c3e01dce66 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:38.623222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b06ecbf0-b374-4679-b902-a5c3e01dce66 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1217 microversion: 2.1 time: 0.312502 May 10 03:14:38.637334 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 20/53] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:38 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1217 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:38.647815 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-306929120", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73d317d2-6d6e-4f15-9854-843c84b4e47e"}], "security_groups": [{"name": "tempest-securitygroup--868608471"}], "key_name": "tempest-keypair-66328474", "user_data": "}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:39.296348 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Flavor limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:14:39.296348 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Image limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:14:39.296348 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Flavor pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:14:39.304942 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Image pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:14:39.306606 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:14:39.329792 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:39.333629 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:39.337525 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:39.338199 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:39.415829 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:14:39.439946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for user 775d3d61ab8d42c3a528028592ad71f8 and project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:14:39.514938 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Going to run 1 instances... {{(pid=117120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:14:39.533747 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:14:39.678045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-625dde7f-f7be-4901-8777-cfbc76fd1d6c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.911431 May 10 03:14:39.685998 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 34/54] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:14:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:14:39.693106 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:39.694246 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:39.704884 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:39.705804 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:39.708820 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:39.709928 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:39.847737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:39.884681 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:39.890885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] validate_networks() for [('73d317d2-6d6e-4f15-9854-843c84b4e47e', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:14:39.898087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:39.908844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-84979038-e034-4e9f-987a-c13ac8784123 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1278 microversion: 2.20 time: 0.211738 May 10 03:14:39.910724 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 35/55] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:39 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:39.934319 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-863a632c-a860-48b9-9cc1-de7bd7c31374 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:39.934888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-863a632c-a860-48b9-9cc1-de7bd7c31374 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:39.966643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-863a632c-a860-48b9-9cc1-de7bd7c31374 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:39.967106 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-863a632c-a860-48b9-9cc1-de7bd7c31374 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:39.967895 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-863a632c-a860-48b9-9cc1-de7bd7c31374 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:39.968555 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-863a632c-a860-48b9-9cc1-de7bd7c31374 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:40.289601 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-863a632c-a860-48b9-9cc1-de7bd7c31374 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:40.302624 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-863a632c-a860-48b9-9cc1-de7bd7c31374 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 0.387928 May 10 03:14:40.305207 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 36/56] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:39 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:40.327394 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0362681d-82b2-4ce1-8bac-b9b6d2715e45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:40.329113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0362681d-82b2-4ce1-8bac-b9b6d2715e45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:40.374075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0362681d-82b2-4ce1-8bac-b9b6d2715e45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:40.374666 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0362681d-82b2-4ce1-8bac-b9b6d2715e45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:40.380973 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0362681d-82b2-4ce1-8bac-b9b6d2715e45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:40.385891 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0362681d-82b2-4ce1-8bac-b9b6d2715e45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:40.679370 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0362681d-82b2-4ce1-8bac-b9b6d2715e45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:40.690852 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0362681d-82b2-4ce1-8bac-b9b6d2715e45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1279 microversion: 2.1 time: 0.372978 May 10 03:14:40.695207 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 37/57] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:40 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1279 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:40.711830 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a54400a5-373f-45bc-af87-e27a5222bb32 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:40.713786 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a54400a5-373f-45bc-af87-e27a5222bb32 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:41.014962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a54400a5-373f-45bc-af87-e27a5222bb32 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:41.024740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a54400a5-373f-45bc-af87-e27a5222bb32 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1242 microversion: 2.1 time: 0.327491 May 10 03:14:41.025329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 38/58] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:40 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1242 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:41.040146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:41.045642 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:41.063050 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:41.063151 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:41.063879 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:41.064363 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:41.214212 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:41.230218 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:41.237591 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:41.238750 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ee751d2e-663c-40a4-ac55-171419c0ba23 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1340 microversion: 2.20 time: 0.212516 May 10 03:14:41.240773 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 39/59] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:41 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1340 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:41.322600 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f387c503-9ed2-49f6-9aa6-a7457de08dc7 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:41.324294 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f387c503-9ed2-49f6-9aa6-a7457de08dc7 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:41.332592 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f387c503-9ed2-49f6-9aa6-a7457de08dc7 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:41.337469 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f387c503-9ed2-49f6-9aa6-a7457de08dc7 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:41.338695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f387c503-9ed2-49f6-9aa6-a7457de08dc7 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:41.339472 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f387c503-9ed2-49f6-9aa6-a7457de08dc7 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:41.753831 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f387c503-9ed2-49f6-9aa6-a7457de08dc7 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:41.762818 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f387c503-9ed2-49f6-9aa6-a7457de08dc7 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 0.443905 May 10 03:14:41.763403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 40/60] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:41 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:41.779405 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-01d5a3ea-999f-482f-8c37-770b2e42205e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:41.780046 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-01d5a3ea-999f-482f-8c37-770b2e42205e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:41.797506 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01d5a3ea-999f-482f-8c37-770b2e42205e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:41.809800 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01d5a3ea-999f-482f-8c37-770b2e42205e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:41.811584 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01d5a3ea-999f-482f-8c37-770b2e42205e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:41.812171 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01d5a3ea-999f-482f-8c37-770b2e42205e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:41.996050 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:14:41.997147 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:14:41.997801 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:14:41.998383 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:14:41.998966 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:14:42.011498 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:42.015825 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:42.017041 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:42.017957 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:42.090045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-01d5a3ea-999f-482f-8c37-770b2e42205e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:42.101566 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-01d5a3ea-999f-482f-8c37-770b2e42205e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1279 microversion: 2.1 time: 0.337123 May 10 03:14:42.106728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 41/61] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:41 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1279 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:42.117851 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Getting quotas for project 5d958793e0ab4e6f8d2f296dcf6186f5. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:14:42.133789 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-40ea743e-354b-466a-83c7-d94d9ce19ac7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:42.137563 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-40ea743e-354b-466a-83c7-d94d9ce19ac7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:42.140800 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Getting quotas for user 314a5e1a357c4a73a33391b6f25a44c6 and project 5d958793e0ab4e6f8d2f296dcf6186f5. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:14:42.151577 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-40ea743e-354b-466a-83c7-d94d9ce19ac7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:42.152049 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-40ea743e-354b-466a-83c7-d94d9ce19ac7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:42.154004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-40ea743e-354b-466a-83c7-d94d9ce19ac7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:42.156511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-40ea743e-354b-466a-83c7-d94d9ce19ac7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:42.168233 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:14:42.170656 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:14:42.258624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fc918c6c-5751-4cdf-bc78-11d24b1add6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.619668 May 10 03:14:42.260066 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 21/62] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:14:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 3622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:14:42.395260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-40ea743e-354b-466a-83c7-d94d9ce19ac7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:42.404504 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-40ea743e-354b-466a-83c7-d94d9ce19ac7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1300 microversion: 2.1 time: 0.292647 May 10 03:14:42.409886 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 42/63] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:42 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1300 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:42.444257 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:42.445571 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:42.458593 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:42.459428 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:42.462094 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:42.464028 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:42.504502 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-198b035b-4e1f-4c1a-a2b2-af7476f1844e req-95cca230-cf11-4d6c-bccd-1cf69d897b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364eff63-27a1-4e99-bb61-81ac36f72973", "name": "network-vif-plugged", "status": "completed", "tag": "1250bf8e-004a-44ae-a5a9-5013188a9085"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:42.515025 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-198b035b-4e1f-4c1a-a2b2-af7476f1844e req-95cca230-cf11-4d6c-bccd-1cf69d897b70 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:42.515860 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-198b035b-4e1f-4c1a-a2b2-af7476f1844e req-95cca230-cf11-4d6c-bccd-1cf69d897b70 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:42.547142 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-198b035b-4e1f-4c1a-a2b2-af7476f1844e req-95cca230-cf11-4d6c-bccd-1cf69d897b70 service nova] Creating event network-vif-plugged:1250bf8e-004a-44ae-a5a9-5013188a9085 for instance 364eff63-27a1-4e99-bb61-81ac36f72973 on hv-cinder-83009 May 10 03:14:42.568931 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-198b035b-4e1f-4c1a-a2b2-af7476f1844e req-95cca230-cf11-4d6c-bccd-1cf69d897b70 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.301481 May 10 03:14:42.579838 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 22/64] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:42.586418 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2040f3e3-780e-4822-87e4-f040984a07b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:42.587324 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2040f3e3-780e-4822-87e4-f040984a07b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:42.747140 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2040f3e3-780e-4822-87e4-f040984a07b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:42.769340 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:42.778119 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:42.783240 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2040f3e3-780e-4822-87e4-f040984a07b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1235 microversion: 2.1 time: 0.201220 May 10 03:14:42.786958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 23/65] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:42 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1235 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:42.794172 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:42.795552 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9ad53d75-b6c7-43da-a029-c97360951760 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1340 microversion: 2.20 time: 0.384721 May 10 03:14:42.801324 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-55e5fbf0-6b2e-4a58-bbdb-aea4b355e3b8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:42.805929 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-55e5fbf0-6b2e-4a58-bbdb-aea4b355e3b8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:42.811132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 43/66] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:42 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1340 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:42.832256 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-55e5fbf0-6b2e-4a58-bbdb-aea4b355e3b8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:42.833203 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-55e5fbf0-6b2e-4a58-bbdb-aea4b355e3b8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:42.834557 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-55e5fbf0-6b2e-4a58-bbdb-aea4b355e3b8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:42.835360 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-55e5fbf0-6b2e-4a58-bbdb-aea4b355e3b8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:43.125615 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d4723a5b-a3ad-41df-a1fd-c43be228d599 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:43.126689 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d4723a5b-a3ad-41df-a1fd-c43be228d599 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:43.146121 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4723a5b-a3ad-41df-a1fd-c43be228d599 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:43.146943 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4723a5b-a3ad-41df-a1fd-c43be228d599 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:43.148070 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4723a5b-a3ad-41df-a1fd-c43be228d599 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:43.149163 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4723a5b-a3ad-41df-a1fd-c43be228d599 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:43.750541 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-55e5fbf0-6b2e-4a58-bbdb-aea4b355e3b8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:43.759938 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-55e5fbf0-6b2e-4a58-bbdb-aea4b355e3b8 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 0.971748 May 10 03:14:43.763880 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 24/67] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:42 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:43.778698 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-37aff28d-8b82-41a4-a0b0-9c5eb83da8c5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:43.782751 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-37aff28d-8b82-41a4-a0b0-9c5eb83da8c5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:43.807511 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37aff28d-8b82-41a4-a0b0-9c5eb83da8c5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:43.817702 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37aff28d-8b82-41a4-a0b0-9c5eb83da8c5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:43.818873 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37aff28d-8b82-41a4-a0b0-9c5eb83da8c5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:43.819326 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37aff28d-8b82-41a4-a0b0-9c5eb83da8c5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:44.070503 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d4723a5b-a3ad-41df-a1fd-c43be228d599 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:44.080228 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d4723a5b-a3ad-41df-a1fd-c43be228d599 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.960296 May 10 03:14:44.083988 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 44/68] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:43 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:44.095785 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-844bc7e0-3325-4825-ade2-8a91ede49756 req-cd520731-3c30-4152-8657-8138ed5557c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a709d3d8-e66d-4642-aee4-392801ae2f15", "tag": "fd37adcc-6c61-4249-b29c-d3a717224790"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:44.112437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-844bc7e0-3325-4825-ade2-8a91ede49756 req-cd520731-3c30-4152-8657-8138ed5557c0 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:44.113126 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-844bc7e0-3325-4825-ade2-8a91ede49756 req-cd520731-3c30-4152-8657-8138ed5557c0 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:44.144103 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-844bc7e0-3325-4825-ade2-8a91ede49756 req-cd520731-3c30-4152-8657-8138ed5557c0 service nova] Creating event network-changed:fd37adcc-6c61-4249-b29c-d3a717224790 for instance a709d3d8-e66d-4642-aee4-392801ae2f15 on hv-cinder-83009 May 10 03:14:44.144949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-844bc7e0-3325-4825-ade2-8a91ede49756 req-cd520731-3c30-4152-8657-8138ed5557c0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 03:14:44.146954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-af95965a-f03b-403e-95c2-12efd2b8b82a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:44.147623 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-af95965a-f03b-403e-95c2-12efd2b8b82a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:44.148598 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-af95965a-f03b-403e-95c2-12efd2b8b82a None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:44.149207 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-af95965a-f03b-403e-95c2-12efd2b8b82a None None] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:44.174550 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.compute.rpcapi [None req-af95965a-f03b-403e-95c2-12efd2b8b82a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 03:14:44.176110 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-af95965a-f03b-403e-95c2-12efd2b8b82a None None] Releasing lock "compute-rpcapi-router" {{(pid=117120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 03:14:44.243277 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-af95965a-f03b-403e-95c2-12efd2b8b82a None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156126 May 10 03:14:44.244961 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 45/69] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:44.263498 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2fc2e45d-9c4b-41a3-a5fa-3675c53b5e27 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:44.267586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2fc2e45d-9c4b-41a3-a5fa-3675c53b5e27 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:44.290992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2fc2e45d-9c4b-41a3-a5fa-3675c53b5e27 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:44.294480 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2fc2e45d-9c4b-41a3-a5fa-3675c53b5e27 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:44.295680 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2fc2e45d-9c4b-41a3-a5fa-3675c53b5e27 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:44.304534 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2fc2e45d-9c4b-41a3-a5fa-3675c53b5e27 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:44.457581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-37aff28d-8b82-41a4-a0b0-9c5eb83da8c5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:44.470337 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-37aff28d-8b82-41a4-a0b0-9c5eb83da8c5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1300 microversion: 2.1 time: 0.702183 May 10 03:14:44.472280 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 25/70] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:43 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1300 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:44.482669 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:44.485050 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:44.498328 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:44.500701 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:44.503419 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:44.506327 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:44.592025 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2fc2e45d-9c4b-41a3-a5fa-3675c53b5e27 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:44.606815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2fc2e45d-9c4b-41a3-a5fa-3675c53b5e27 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1305 microversion: 2.1 time: 0.360255 May 10 03:14:44.607314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 46/71] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:44 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1305 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:44.782694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-02c4ab01-8bcd-4afb-84c4-5c1bf4790599 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:44.783768 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-02c4ab01-8bcd-4afb-84c4-5c1bf4790599 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:44.793204 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-02c4ab01-8bcd-4afb-84c4-5c1bf4790599 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:44.794654 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-02c4ab01-8bcd-4afb-84c4-5c1bf4790599 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:44.796095 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-02c4ab01-8bcd-4afb-84c4-5c1bf4790599 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:44.797232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-02c4ab01-8bcd-4afb-84c4-5c1bf4790599 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:45.020154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:45.038738 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:45.040758 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:45.042115 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-aa30fba9-1420-48b1-89bc-b0a0c15304cc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1408 microversion: 2.20 time: 0.568065 May 10 03:14:45.043279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 26/72] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:44 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1408 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:45.099022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4dedb3ed-609b-4694-955c-c439dd2839f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:45.099687 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4dedb3ed-609b-4694-955c-c439dd2839f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:45.107825 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4dedb3ed-609b-4694-955c-c439dd2839f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:45.108300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4dedb3ed-609b-4694-955c-c439dd2839f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:45.110713 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4dedb3ed-609b-4694-955c-c439dd2839f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:45.111178 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4dedb3ed-609b-4694-955c-c439dd2839f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:45.464145 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-02c4ab01-8bcd-4afb-84c4-5c1bf4790599 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:45.477016 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-02c4ab01-8bcd-4afb-84c4-5c1bf4790599 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 0.699139 May 10 03:14:45.481044 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 47/73] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:44 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:45.503288 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2a6d0fce-32a0-487d-b4dd-3fb014cbe95b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:45.504317 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2a6d0fce-32a0-487d-b4dd-3fb014cbe95b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:45.536055 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2a6d0fce-32a0-487d-b4dd-3fb014cbe95b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:45.536720 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2a6d0fce-32a0-487d-b4dd-3fb014cbe95b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:45.539987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2a6d0fce-32a0-487d-b4dd-3fb014cbe95b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:45.540697 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2a6d0fce-32a0-487d-b4dd-3fb014cbe95b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:45.725350 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4dedb3ed-609b-4694-955c-c439dd2839f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:45.733865 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4dedb3ed-609b-4694-955c-c439dd2839f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.639856 May 10 03:14:45.734706 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 27/74] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:45 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:45.739885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1be16295-304f-4666-8156-38aaedc70a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:45.740760 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1be16295-304f-4666-8156-38aaedc70a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:45.747121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1be16295-304f-4666-8156-38aaedc70a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:45.748489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1be16295-304f-4666-8156-38aaedc70a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:45.749549 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1be16295-304f-4666-8156-38aaedc70a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:45.750064 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1be16295-304f-4666-8156-38aaedc70a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:45.828332 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1be16295-304f-4666-8156-38aaedc70a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:45.839782 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1be16295-304f-4666-8156-38aaedc70a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1293 microversion: 2.1 time: 0.103820 May 10 03:14:45.840819 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 28/75] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:45 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:46.007127 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2a6d0fce-32a0-487d-b4dd-3fb014cbe95b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:46.016536 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2a6d0fce-32a0-487d-b4dd-3fb014cbe95b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.517485 May 10 03:14:46.028955 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 48/76] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:45 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:46.061677 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:46.063207 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:46.074973 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:46.077604 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:46.080956 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:46.081775 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:46.330275 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:46.342368 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:46.344328 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:46.346119 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7df627ea-522f-4547-8398-c4844dcc1601 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1408 microversion: 2.20 time: 0.289070 May 10 03:14:46.347862 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 29/77] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:46 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:46.451163 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-6740b3f5-173a-48d4-acd7-66a608f9b3a9 req-63cd5ad1-560f-4423-98cd-2014d828039b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c84baa-9dcf-42e3-bd13-d86cf6b59832", "tag": "b9d6cae9-1585-4490-82f6-fb9945c58311"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:46.464414 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-6740b3f5-173a-48d4-acd7-66a608f9b3a9 req-63cd5ad1-560f-4423-98cd-2014d828039b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:46.465111 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-6740b3f5-173a-48d4-acd7-66a608f9b3a9 req-63cd5ad1-560f-4423-98cd-2014d828039b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:46.488238 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-6740b3f5-173a-48d4-acd7-66a608f9b3a9 req-63cd5ad1-560f-4423-98cd-2014d828039b service nova] Creating event network-changed:b9d6cae9-1585-4490-82f6-fb9945c58311 for instance c8c84baa-9dcf-42e3-bd13-d86cf6b59832 on hv-cinder-83009 May 10 03:14:46.500727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-13a6b6e9-0092-45c6-aa83-d8abb88963ea tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:46.501813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-13a6b6e9-0092-45c6-aa83-d8abb88963ea tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:46.504356 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-6740b3f5-173a-48d4-acd7-66a608f9b3a9 req-63cd5ad1-560f-4423-98cd-2014d828039b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056585 May 10 03:14:46.505153 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 49/78] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:46.516478 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-13a6b6e9-0092-45c6-aa83-d8abb88963ea tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:46.517928 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-13a6b6e9-0092-45c6-aa83-d8abb88963ea tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:46.519809 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-13a6b6e9-0092-45c6-aa83-d8abb88963ea tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:46.520704 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-13a6b6e9-0092-45c6-aa83-d8abb88963ea tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:46.751989 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-146e88cb-c84e-407d-857f-8d0c50f64330 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:46.753262 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-146e88cb-c84e-407d-857f-8d0c50f64330 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:46.759815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-146e88cb-c84e-407d-857f-8d0c50f64330 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:46.760473 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-146e88cb-c84e-407d-857f-8d0c50f64330 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:46.761636 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-146e88cb-c84e-407d-857f-8d0c50f64330 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:46.762218 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-146e88cb-c84e-407d-857f-8d0c50f64330 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:46.794488 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-13a6b6e9-0092-45c6-aa83-d8abb88963ea tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:46.803684 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-13a6b6e9-0092-45c6-aa83-d8abb88963ea tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1315 microversion: 2.1 time: 0.310373 May 10 03:14:46.813071 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 30/79] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:46 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:46.858918 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a69a76a6-b724-402c-9eed-6ebdbb4ea4a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:46.859661 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a69a76a6-b724-402c-9eed-6ebdbb4ea4a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:46.867571 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a69a76a6-b724-402c-9eed-6ebdbb4ea4a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:46.868293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a69a76a6-b724-402c-9eed-6ebdbb4ea4a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:46.869335 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a69a76a6-b724-402c-9eed-6ebdbb4ea4a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:46.869858 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a69a76a6-b724-402c-9eed-6ebdbb4ea4a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:47.552307 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-146e88cb-c84e-407d-857f-8d0c50f64330 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:47.560863 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-146e88cb-c84e-407d-857f-8d0c50f64330 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.812911 May 10 03:14:47.561628 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 50/80] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:46 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:47.571065 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-66e78ddc-0711-45c5-b909-db218ea0560e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:47.579158 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-66e78ddc-0711-45c5-b909-db218ea0560e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:47.592666 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-66e78ddc-0711-45c5-b909-db218ea0560e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:47.593132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-66e78ddc-0711-45c5-b909-db218ea0560e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:47.598138 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-66e78ddc-0711-45c5-b909-db218ea0560e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:47.598651 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-66e78ddc-0711-45c5-b909-db218ea0560e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:47.970975 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a69a76a6-b724-402c-9eed-6ebdbb4ea4a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:47.978977 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a69a76a6-b724-402c-9eed-6ebdbb4ea4a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 1.123949 May 10 03:14:47.990014 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 31/81] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:46 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:47.995238 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:47.996025 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:48.002063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.003361 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:48.004335 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.004958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:48.421246 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-66e78ddc-0711-45c5-b909-db218ea0560e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:48.436626 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:48.441104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-66e78ddc-0711-45c5-b909-db218ea0560e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.878083 May 10 03:14:48.442365 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 51/82] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:47 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:48.445455 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:48.446974 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:48.448137 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3e676814-d8df-44c7-9b4a-2b2ad4b1bd91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1408 microversion: 2.20 time: 0.456933 May 10 03:14:48.468305 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 32/83] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:47 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:48.474374 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0511689b-70f1-4f77-8c0c-56046db70e3d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:48.474995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0511689b-70f1-4f77-8c0c-56046db70e3d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:48.492851 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0511689b-70f1-4f77-8c0c-56046db70e3d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.493302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0511689b-70f1-4f77-8c0c-56046db70e3d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:48.494086 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0511689b-70f1-4f77-8c0c-56046db70e3d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.494519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0511689b-70f1-4f77-8c0c-56046db70e3d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:48.611037 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-bf6176de-b2dd-44c4-9cfe-665f7949b19c req-18ba2f8d-a5e0-420f-9e62-4afa476b3322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f", "tag": "3ec8beef-b88c-43f8-8d89-f6c589198e59"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:48.627184 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-bf6176de-b2dd-44c4-9cfe-665f7949b19c req-18ba2f8d-a5e0-420f-9e62-4afa476b3322 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.629021 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-bf6176de-b2dd-44c4-9cfe-665f7949b19c req-18ba2f8d-a5e0-420f-9e62-4afa476b3322 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:48.673774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-bf6176de-b2dd-44c4-9cfe-665f7949b19c req-18ba2f8d-a5e0-420f-9e62-4afa476b3322 service nova] Creating event network-changed:3ec8beef-b88c-43f8-8d89-f6c589198e59 for instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f on hv-cinder-83009 May 10 03:14:48.691177 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-bf6176de-b2dd-44c4-9cfe-665f7949b19c req-18ba2f8d-a5e0-420f-9e62-4afa476b3322 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246728 May 10 03:14:48.693268 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 52/84] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:48.710646 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-56f44c34-3dab-4d94-a7df-77d5650c61d7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:48.711771 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-56f44c34-3dab-4d94-a7df-77d5650c61d7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:48.728191 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-56f44c34-3dab-4d94-a7df-77d5650c61d7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.732465 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-56f44c34-3dab-4d94-a7df-77d5650c61d7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:48.734398 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-56f44c34-3dab-4d94-a7df-77d5650c61d7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.736501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-56f44c34-3dab-4d94-a7df-77d5650c61d7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.018724 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0511689b-70f1-4f77-8c0c-56046db70e3d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:49.027059 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0511689b-70f1-4f77-8c0c-56046db70e3d tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1502 microversion: 2.1 time: 0.557459 May 10 03:14:49.030414 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 33/85] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:48 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1502 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:49.037616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8d9ea5e7-4e05-49f6-8c0a-6cbfced154ae tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:49.040365 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8d9ea5e7-4e05-49f6-8c0a-6cbfced154ae tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:49.072175 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d9ea5e7-4e05-49f6-8c0a-6cbfced154ae tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.072627 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d9ea5e7-4e05-49f6-8c0a-6cbfced154ae tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.073440 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d9ea5e7-4e05-49f6-8c0a-6cbfced154ae tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.073874 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d9ea5e7-4e05-49f6-8c0a-6cbfced154ae tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.326709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8d9ea5e7-4e05-49f6-8c0a-6cbfced154ae tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:49.335000 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8d9ea5e7-4e05-49f6-8c0a-6cbfced154ae tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.303354 May 10 03:14:49.346344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 34/86] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:49 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:49.368592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-93c1e442-64ef-4dd4-a701-86c8e6779395 req-82558643-9173-4d87-b671-dbd6c2039bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a709d3d8-e66d-4642-aee4-392801ae2f15", "name": "network-vif-plugged", "status": "completed", "tag": "fd37adcc-6c61-4249-b29c-d3a717224790"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:49.380400 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-93c1e442-64ef-4dd4-a701-86c8e6779395 req-82558643-9173-4d87-b671-dbd6c2039bb1 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.385425 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-93c1e442-64ef-4dd4-a701-86c8e6779395 req-82558643-9173-4d87-b671-dbd6c2039bb1 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.417880 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-93c1e442-64ef-4dd4-a701-86c8e6779395 req-82558643-9173-4d87-b671-dbd6c2039bb1 service nova] Creating event network-vif-plugged:fd37adcc-6c61-4249-b29c-d3a717224790 for instance a709d3d8-e66d-4642-aee4-392801ae2f15 on hv-cinder-83009 May 10 03:14:49.431529 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-93c1e442-64ef-4dd4-a701-86c8e6779395 req-82558643-9173-4d87-b671-dbd6c2039bb1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066491 May 10 03:14:49.441997 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 35/87] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:49.464449 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0e591a12-3b1e-4f10-a7f4-60203ab2e4e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:49.467360 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0e591a12-3b1e-4f10-a7f4-60203ab2e4e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:49.490109 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e591a12-3b1e-4f10-a7f4-60203ab2e4e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.490469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e591a12-3b1e-4f10-a7f4-60203ab2e4e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.491253 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e591a12-3b1e-4f10-a7f4-60203ab2e4e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.491688 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e591a12-3b1e-4f10-a7f4-60203ab2e4e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.501842 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-56f44c34-3dab-4d94-a7df-77d5650c61d7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:49.516303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-56f44c34-3dab-4d94-a7df-77d5650c61d7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.821353 May 10 03:14:49.519358 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 53/88] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:48 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:49.532138 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:49.533343 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:49.557105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.557762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.558817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.559628 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.678741 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0e591a12-3b1e-4f10-a7f4-60203ab2e4e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:49.690526 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0e591a12-3b1e-4f10-a7f4-60203ab2e4e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.234921 May 10 03:14:49.691774 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 36/89] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:49 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:49.917936 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:49.927546 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:49.933952 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:49.935338 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e64d3238-0446-4b5d-a0d4-37f261814abb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1408 microversion: 2.20 time: 0.414450 May 10 03:14:49.937440 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 54/90] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:49 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1408 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:50.354584 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e0ecd819-9d13-4a5e-ae01-b4c5a7a6aab6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:50.356171 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e0ecd819-9d13-4a5e-ae01-b4c5a7a6aab6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:50.363770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e0ecd819-9d13-4a5e-ae01-b4c5a7a6aab6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.364711 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e0ecd819-9d13-4a5e-ae01-b4c5a7a6aab6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.365651 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e0ecd819-9d13-4a5e-ae01-b4c5a7a6aab6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.366240 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e0ecd819-9d13-4a5e-ae01-b4c5a7a6aab6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.536743 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2f99f104-82fd-4359-8d21-ebfa6a9f69f7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:50.537365 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2f99f104-82fd-4359-8d21-ebfa6a9f69f7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:50.545666 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f99f104-82fd-4359-8d21-ebfa6a9f69f7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.547551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f99f104-82fd-4359-8d21-ebfa6a9f69f7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.550814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f99f104-82fd-4359-8d21-ebfa6a9f69f7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.551721 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f99f104-82fd-4359-8d21-ebfa6a9f69f7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.552823 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e0ecd819-9d13-4a5e-ae01-b4c5a7a6aab6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:50.563940 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e0ecd819-9d13-4a5e-ae01-b4c5a7a6aab6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.214168 May 10 03:14:50.564524 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 37/91] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:50 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:50.709556 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c44bef72-4f7a-4b06-8a73-0faed0befc86 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:50.711151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-c44bef72-4f7a-4b06-8a73-0faed0befc86 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:50.722856 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c44bef72-4f7a-4b06-8a73-0faed0befc86 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.724391 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c44bef72-4f7a-4b06-8a73-0faed0befc86 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.725589 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c44bef72-4f7a-4b06-8a73-0faed0befc86 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.726382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c44bef72-4f7a-4b06-8a73-0faed0befc86 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.738765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2f99f104-82fd-4359-8d21-ebfa6a9f69f7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:50.745303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2f99f104-82fd-4359-8d21-ebfa6a9f69f7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.213622 May 10 03:14:50.745880 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 55/92] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:50 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:50.759288 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-021874e7-fc20-4c7f-9574-84fb4fad6d8c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95f8f7bf-91ac-46d4-90bd-25d98658f83b"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:50.761954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-021874e7-fc20-4c7f-9574-84fb4fad6d8c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:50.771106 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-021874e7-fc20-4c7f-9574-84fb4fad6d8c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.771928 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-021874e7-fc20-4c7f-9574-84fb4fad6d8c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.772925 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-021874e7-fc20-4c7f-9574-84fb4fad6d8c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.773941 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-021874e7-fc20-4c7f-9574-84fb4fad6d8c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.998138 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-c44bef72-4f7a-4b06-8a73-0faed0befc86 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:51.012174 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c44bef72-4f7a-4b06-8a73-0faed0befc86 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.307505 May 10 03:14:51.014857 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 38/93] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:50 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:51.033099 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-21c7e37b-5134-4cba-96d3-b6632e7ca6a0 req-0699464e-cbb6-409f-b123-d0d724e0443d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e867a0c9-e715-4ac3-8be5-1bb4e64f56fb", "tag": "ca4610dc-9a2b-4dfa-a722-526e08fec54d"}, {"name": "network-changed", "server_uuid": "03eee221-c04f-48de-b2eb-5e696a377e0f", "tag": "240b8202-e12a-435e-ba1f-ff9f7b64c768"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:51.058887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-21c7e37b-5134-4cba-96d3-b6632e7ca6a0 req-0699464e-cbb6-409f-b123-d0d724e0443d service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:51.059575 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-21c7e37b-5134-4cba-96d3-b6632e7ca6a0 req-0699464e-cbb6-409f-b123-d0d724e0443d service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:51.076873 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-21c7e37b-5134-4cba-96d3-b6632e7ca6a0 req-0699464e-cbb6-409f-b123-d0d724e0443d service nova] Creating event network-changed:ca4610dc-9a2b-4dfa-a722-526e08fec54d for instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb on hv-cinder-83009 May 10 03:14:51.086124 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-21c7e37b-5134-4cba-96d3-b6632e7ca6a0 req-0699464e-cbb6-409f-b123-d0d724e0443d service nova] Creating event network-changed:240b8202-e12a-435e-ba1f-ff9f7b64c768 for instance 03eee221-c04f-48de-b2eb-5e696a377e0f on hv-cinder-83009 May 10 03:14:51.092134 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-21c7e37b-5134-4cba-96d3-b6632e7ca6a0 req-0699464e-cbb6-409f-b123-d0d724e0443d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075719 May 10 03:14:51.097954 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 39/94] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:51.118121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:51.124208 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:51.164852 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:51.165200 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:51.165990 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:51.166428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:51.438605 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:51.452080 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:51.459405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:51.462080 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3128b1f5-a644-4b62-a3e7-925ebafbbaa1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1408 microversion: 2.20 time: 0.358630 May 10 03:14:51.477470 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 40/95] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:51 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1408 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:51.595913 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-36104298-f13a-49a9-9745-af7b23587813 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:51.597750 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-36104298-f13a-49a9-9745-af7b23587813 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:51.613209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-36104298-f13a-49a9-9745-af7b23587813 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:51.613209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-36104298-f13a-49a9-9745-af7b23587813 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:51.617133 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-36104298-f13a-49a9-9745-af7b23587813 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:51.617810 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-36104298-f13a-49a9-9745-af7b23587813 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:51.777769 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-021874e7-fc20-4c7f-9574-84fb4fad6d8c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "POST /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030278 May 10 03:14:51.778530 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 56/96] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:14:50 2022] POST /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:51.787781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-14753a9a-0b20-47bf-a462-3dcc9ca7759b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:51.788978 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-14753a9a-0b20-47bf-a462-3dcc9ca7759b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:51.803608 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-14753a9a-0b20-47bf-a462-3dcc9ca7759b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:51.804926 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-14753a9a-0b20-47bf-a462-3dcc9ca7759b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:51.805952 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-14753a9a-0b20-47bf-a462-3dcc9ca7759b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:51.806621 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-14753a9a-0b20-47bf-a462-3dcc9ca7759b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:51.883740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-36104298-f13a-49a9-9745-af7b23587813 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:51.895596 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-36104298-f13a-49a9-9745-af7b23587813 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.304634 May 10 03:14:51.896209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 41/97] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:51 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:52.030293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a8fe6ffb-b629-456c-bc66-f0c46c205c7e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:52.030906 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a8fe6ffb-b629-456c-bc66-f0c46c205c7e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:52.047046 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8fe6ffb-b629-456c-bc66-f0c46c205c7e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:52.047877 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8fe6ffb-b629-456c-bc66-f0c46c205c7e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:52.048929 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8fe6ffb-b629-456c-bc66-f0c46c205c7e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:52.050121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8fe6ffb-b629-456c-bc66-f0c46c205c7e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:52.209708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a8fe6ffb-b629-456c-bc66-f0c46c205c7e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:52.220394 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a8fe6ffb-b629-456c-bc66-f0c46c205c7e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.193902 May 10 03:14:52.220997 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 42/98] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:52 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:52.249275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-14753a9a-0b20-47bf-a462-3dcc9ca7759b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:52.258916 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-14753a9a-0b20-47bf-a462-3dcc9ca7759b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.478733 May 10 03:14:52.259860 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 57/99] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:51 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:52.486568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:52.488037 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:52.499730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:52.500186 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:52.503641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:52.504160 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:52.713260 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:52.723575 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:52.725107 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:52.726226 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d9954d9e-6060-400c-9648-1c6e3db05441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1408 microversion: 2.20 time: 0.243752 May 10 03:14:52.733246 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 43/100] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:52 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:52.913272 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-42e65949-127f-477a-9fa4-9dad1778455b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:52.922101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-42e65949-127f-477a-9fa4-9dad1778455b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:52.929758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42e65949-127f-477a-9fa4-9dad1778455b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:52.930631 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42e65949-127f-477a-9fa4-9dad1778455b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:52.931960 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42e65949-127f-477a-9fa4-9dad1778455b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:52.932621 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42e65949-127f-477a-9fa4-9dad1778455b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:53.241283 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0ebf09c3-c98a-4a1d-84de-f98e1766a815 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:53.242186 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0ebf09c3-c98a-4a1d-84de-f98e1766a815 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:53.253672 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0ebf09c3-c98a-4a1d-84de-f98e1766a815 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:53.254045 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0ebf09c3-c98a-4a1d-84de-f98e1766a815 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:53.254833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0ebf09c3-c98a-4a1d-84de-f98e1766a815 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:53.255268 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0ebf09c3-c98a-4a1d-84de-f98e1766a815 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:53.288344 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-42e65949-127f-477a-9fa4-9dad1778455b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:53.298261 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-42e65949-127f-477a-9fa4-9dad1778455b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.388934 May 10 03:14:53.298847 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 58/101] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:52 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:53.312162 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5d9abc42-7a55-4c34-9114-79a609f98e12 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:53.312830 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5d9abc42-7a55-4c34-9114-79a609f98e12 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:53.320797 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5d9abc42-7a55-4c34-9114-79a609f98e12 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:53.321523 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5d9abc42-7a55-4c34-9114-79a609f98e12 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:53.322462 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5d9abc42-7a55-4c34-9114-79a609f98e12 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:53.323052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5d9abc42-7a55-4c34-9114-79a609f98e12 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:53.513931 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5d9abc42-7a55-4c34-9114-79a609f98e12 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:53.532677 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5d9abc42-7a55-4c34-9114-79a609f98e12 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.232448 May 10 03:14:53.533431 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 59/102] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:53 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:53.561159 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0ebf09c3-c98a-4a1d-84de-f98e1766a815 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:53.572313 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0ebf09c3-c98a-4a1d-84de-f98e1766a815 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.336606 May 10 03:14:53.573779 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 44/103] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:53 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:53.678198 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-0a19228e-ae27-4d1e-a17c-e9dec22d9529 req-12f8193b-ed8f-4c51-a25e-84f5f954bde7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f", "name": "network-vif-plugged", "status": "completed", "tag": "3ec8beef-b88c-43f8-8d89-f6c589198e59"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:53.692143 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-0a19228e-ae27-4d1e-a17c-e9dec22d9529 req-12f8193b-ed8f-4c51-a25e-84f5f954bde7 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:53.693210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-0a19228e-ae27-4d1e-a17c-e9dec22d9529 req-12f8193b-ed8f-4c51-a25e-84f5f954bde7 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:53.716868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-0a19228e-ae27-4d1e-a17c-e9dec22d9529 req-12f8193b-ed8f-4c51-a25e-84f5f954bde7 service nova] Creating event network-vif-plugged:3ec8beef-b88c-43f8-8d89-f6c589198e59 for instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f on hv-cinder-83009 May 10 03:14:53.727102 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-0a19228e-ae27-4d1e-a17c-e9dec22d9529 req-12f8193b-ed8f-4c51-a25e-84f5f954bde7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058609 May 10 03:14:53.729648 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 60/104] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:53.747320 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:53.747933 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:53.764854 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:53.765309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:53.766148 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:53.766598 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:54.317732 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-468aa942-3062-47bf-a8dd-93313f0e4bb9 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:54.319031 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-468aa942-3062-47bf-a8dd-93313f0e4bb9 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:54.327850 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-468aa942-3062-47bf-a8dd-93313f0e4bb9 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:54.328503 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-468aa942-3062-47bf-a8dd-93313f0e4bb9 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:54.329513 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-468aa942-3062-47bf-a8dd-93313f0e4bb9 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:54.330323 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-468aa942-3062-47bf-a8dd-93313f0e4bb9 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:54.333340 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:54.358225 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:54.363585 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:54.366922 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-37a52e85-6c3f-4bdc-926d-da1fbdca566a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1408 microversion: 2.20 time: 0.623312 May 10 03:14:54.368294 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 45/105] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:53 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1408 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:54.520296 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-468aa942-3062-47bf-a8dd-93313f0e4bb9 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:54.527883 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-468aa942-3062-47bf-a8dd-93313f0e4bb9 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.216031 May 10 03:14:54.528462 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 61/106] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:54 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:54.550459 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1dc6ed45-71ba-48d4-b7b1-9a848d0a2068 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:54.551355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1dc6ed45-71ba-48d4-b7b1-9a848d0a2068 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:54.560640 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1dc6ed45-71ba-48d4-b7b1-9a848d0a2068 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:54.561158 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1dc6ed45-71ba-48d4-b7b1-9a848d0a2068 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:54.562012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1dc6ed45-71ba-48d4-b7b1-9a848d0a2068 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:54.564214 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1dc6ed45-71ba-48d4-b7b1-9a848d0a2068 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:54.590443 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8bfd7880-91e4-4453-b5a9-1976af55bbb3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:54.591058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8bfd7880-91e4-4453-b5a9-1976af55bbb3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:54.603999 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8bfd7880-91e4-4453-b5a9-1976af55bbb3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:54.604449 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8bfd7880-91e4-4453-b5a9-1976af55bbb3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:54.605245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8bfd7880-91e4-4453-b5a9-1976af55bbb3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:54.605834 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8bfd7880-91e4-4453-b5a9-1976af55bbb3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:54.759656 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1dc6ed45-71ba-48d4-b7b1-9a848d0a2068 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:54.769136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8bfd7880-91e4-4453-b5a9-1976af55bbb3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:54.770049 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1dc6ed45-71ba-48d4-b7b1-9a848d0a2068 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.224383 May 10 03:14:54.770838 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 46/107] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:54 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:54.777124 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8bfd7880-91e4-4453-b5a9-1976af55bbb3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.190407 May 10 03:14:54.786498 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 62/108] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:54 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:55.387749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:55.388379 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:55.395931 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.396709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.397645 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.398225 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.546249 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dd633b25-960f-434b-b874-6b7149fe2064 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:55.546855 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-dd633b25-960f-434b-b874-6b7149fe2064 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:55.577270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dd633b25-960f-434b-b874-6b7149fe2064 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.577725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dd633b25-960f-434b-b874-6b7149fe2064 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.578510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dd633b25-960f-434b-b874-6b7149fe2064 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.582502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dd633b25-960f-434b-b874-6b7149fe2064 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.623556 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:55.635288 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:55.637005 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:55.641928 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9cef6703-670c-4722-a8a0-be54f5ef7d92 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1408 microversion: 2.20 time: 0.260134 May 10 03:14:55.652959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 47/109] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:55 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:55.778216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-6bcd234b-8fbe-4778-8a19-0c40b4662e99 req-4533a424-9f50-43fc-b196-874f9d2509c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c84baa-9dcf-42e3-bd13-d86cf6b59832", "name": "network-vif-plugged", "status": "completed", "tag": "b9d6cae9-1585-4490-82f6-fb9945c58311"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:55.796511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-dd633b25-960f-434b-b874-6b7149fe2064 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:55.797909 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-6bcd234b-8fbe-4778-8a19-0c40b4662e99 req-4533a424-9f50-43fc-b196-874f9d2509c2 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.798714 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-6bcd234b-8fbe-4778-8a19-0c40b4662e99 req-4533a424-9f50-43fc-b196-874f9d2509c2 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.806818 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-dd633b25-960f-434b-b874-6b7149fe2064 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.264939 May 10 03:14:55.821841 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-6bcd234b-8fbe-4778-8a19-0c40b4662e99 req-4533a424-9f50-43fc-b196-874f9d2509c2 service nova] Creating event network-vif-plugged:b9d6cae9-1585-4490-82f6-fb9945c58311 for instance c8c84baa-9dcf-42e3-bd13-d86cf6b59832 on hv-cinder-83009 May 10 03:14:55.822720 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 63/110] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:55 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:55.828351 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-6bcd234b-8fbe-4778-8a19-0c40b4662e99 req-4533a424-9f50-43fc-b196-874f9d2509c2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053994 May 10 03:14:55.829717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 48/111] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:55.837953 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f60a94be-e5a9-4aca-99cc-a37db5d6845e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:55.838546 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b7dc1250-a9bf-4245-bada-fb4ffb949fcd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:55.839188 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f60a94be-e5a9-4aca-99cc-a37db5d6845e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:55.839579 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b7dc1250-a9bf-4245-bada-fb4ffb949fcd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:55.846719 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f60a94be-e5a9-4aca-99cc-a37db5d6845e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.847254 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f60a94be-e5a9-4aca-99cc-a37db5d6845e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.848350 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b7dc1250-a9bf-4245-bada-fb4ffb949fcd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.848672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f60a94be-e5a9-4aca-99cc-a37db5d6845e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.849344 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f60a94be-e5a9-4aca-99cc-a37db5d6845e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.849779 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b7dc1250-a9bf-4245-bada-fb4ffb949fcd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.850571 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b7dc1250-a9bf-4245-bada-fb4ffb949fcd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.851193 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b7dc1250-a9bf-4245-bada-fb4ffb949fcd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:56.281671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b7dc1250-a9bf-4245-bada-fb4ffb949fcd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:56.290207 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b7dc1250-a9bf-4245-bada-fb4ffb949fcd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.458507 May 10 03:14:56.290807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 49/112] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:55 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:56.406437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f60a94be-e5a9-4aca-99cc-a37db5d6845e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:56.430635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f60a94be-e5a9-4aca-99cc-a37db5d6845e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.602132 May 10 03:14:56.431404 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 64/113] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:55 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:56.675306 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:56.675957 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:56.683742 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:56.684183 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:56.685014 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:56.685387 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:56.831414 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a23a8700-32bc-48bc-be95-52b2ac0cacb5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:56.832851 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a23a8700-32bc-48bc-be95-52b2ac0cacb5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:56.855540 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a23a8700-32bc-48bc-be95-52b2ac0cacb5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:56.856232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a23a8700-32bc-48bc-be95-52b2ac0cacb5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:56.859515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a23a8700-32bc-48bc-be95-52b2ac0cacb5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:56.860201 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a23a8700-32bc-48bc-be95-52b2ac0cacb5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:56.947351 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:56.958425 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:56.963475 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:56.965937 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-233aaed6-ac54-472d-98f3-c1defa710d3e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1599 microversion: 2.20 time: 0.306138 May 10 03:14:56.968958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 50/114] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:14:56 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1599 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:14:56.986326 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a2fe23e0-88da-4e6f-bf4c-f9437a95a1ab tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:56.988379 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a2fe23e0-88da-4e6f-bf4c-f9437a95a1ab tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:56.999510 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a2fe23e0-88da-4e6f-bf4c-f9437a95a1ab tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:56.999961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a2fe23e0-88da-4e6f-bf4c-f9437a95a1ab tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:57.002234 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a2fe23e0-88da-4e6f-bf4c-f9437a95a1ab tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:57.003463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a2fe23e0-88da-4e6f-bf4c-f9437a95a1ab tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:57.234581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a2fe23e0-88da-4e6f-bf4c-f9437a95a1ab tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.252241 May 10 03:14:57.235223 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 51/115] 10.222.0.55 () {60 vars in 1315 bytes} [Tue May 10 03:14:56 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:14:57.281643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a23a8700-32bc-48bc-be95-52b2ac0cacb5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:57.298223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a23a8700-32bc-48bc-be95-52b2ac0cacb5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.472302 May 10 03:14:57.301078 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 65/116] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:56 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:57.308061 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8470bf61-e21f-4c7d-9677-0861414f0b13 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:57.310826 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8470bf61-e21f-4c7d-9677-0861414f0b13 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:57.319284 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8470bf61-e21f-4c7d-9677-0861414f0b13 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:57.319745 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8470bf61-e21f-4c7d-9677-0861414f0b13 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:57.320874 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8470bf61-e21f-4c7d-9677-0861414f0b13 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:57.321371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8470bf61-e21f-4c7d-9677-0861414f0b13 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:57.455440 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5d7a860f-8494-47a0-beb6-9922b5ce5ba1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:57.456852 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5d7a860f-8494-47a0-beb6-9922b5ce5ba1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:57.467979 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5d7a860f-8494-47a0-beb6-9922b5ce5ba1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:57.468574 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5d7a860f-8494-47a0-beb6-9922b5ce5ba1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:57.469647 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5d7a860f-8494-47a0-beb6-9922b5ce5ba1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:57.471465 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5d7a860f-8494-47a0-beb6-9922b5ce5ba1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:57.633972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5d7a860f-8494-47a0-beb6-9922b5ce5ba1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:57.641457 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5d7a860f-8494-47a0-beb6-9922b5ce5ba1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1321 microversion: 2.1 time: 0.190823 May 10 03:14:57.642592 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 66/117] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:57 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:57.687422 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8470bf61-e21f-4c7d-9677-0861414f0b13 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:57.698953 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8470bf61-e21f-4c7d-9677-0861414f0b13 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.394848 May 10 03:14:57.699675 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 52/118] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:57 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:58.315979 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cee8e485-6b7a-4f29-9ace-ac3d3e973ff4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:58.317223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-cee8e485-6b7a-4f29-9ace-ac3d3e973ff4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:58.327824 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cee8e485-6b7a-4f29-9ace-ac3d3e973ff4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:58.329904 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cee8e485-6b7a-4f29-9ace-ac3d3e973ff4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:58.334755 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cee8e485-6b7a-4f29-9ace-ac3d3e973ff4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:58.335774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cee8e485-6b7a-4f29-9ace-ac3d3e973ff4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:58.422786 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-1e93ce59-c020-4582-a9c0-9e12bc5801ab req-6c091d2a-5837-481b-a704-a0d1f0faf8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e867a0c9-e715-4ac3-8be5-1bb4e64f56fb", "name": "network-vif-plugged", "status": "completed", "tag": "ca4610dc-9a2b-4dfa-a722-526e08fec54d"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:58.453043 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-1e93ce59-c020-4582-a9c0-9e12bc5801ab req-6c091d2a-5837-481b-a704-a0d1f0faf8dc service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:58.456738 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-1e93ce59-c020-4582-a9c0-9e12bc5801ab req-6c091d2a-5837-481b-a704-a0d1f0faf8dc service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:58.487188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-1e93ce59-c020-4582-a9c0-9e12bc5801ab req-6c091d2a-5837-481b-a704-a0d1f0faf8dc service nova] Creating event network-vif-plugged:ca4610dc-9a2b-4dfa-a722-526e08fec54d for instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb on hv-cinder-83009 May 10 03:14:58.501277 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-1e93ce59-c020-4582-a9c0-9e12bc5801ab req-6c091d2a-5837-481b-a704-a0d1f0faf8dc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083490 May 10 03:14:58.504188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 53/119] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:14:58.660353 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-dad28b29-e83c-4037-b352-9321f73a0578 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:58.661157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-dad28b29-e83c-4037-b352-9321f73a0578 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:58.668127 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-cee8e485-6b7a-4f29-9ace-ac3d3e973ff4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:58.677253 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dad28b29-e83c-4037-b352-9321f73a0578 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:58.679046 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dad28b29-e83c-4037-b352-9321f73a0578 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:58.679937 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dad28b29-e83c-4037-b352-9321f73a0578 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:58.680390 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dad28b29-e83c-4037-b352-9321f73a0578 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:58.683852 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-cee8e485-6b7a-4f29-9ace-ac3d3e973ff4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.371886 May 10 03:14:58.693659 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 67/120] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:58 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:58.718374 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5cddcf62-9925-4269-aa90-9ce40ceef544 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:58.722436 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5cddcf62-9925-4269-aa90-9ce40ceef544 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:58.732768 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5cddcf62-9925-4269-aa90-9ce40ceef544 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:58.733832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5cddcf62-9925-4269-aa90-9ce40ceef544 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:58.734966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5cddcf62-9925-4269-aa90-9ce40ceef544 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:58.735601 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5cddcf62-9925-4269-aa90-9ce40ceef544 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:58.957907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5cddcf62-9925-4269-aa90-9ce40ceef544 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:58.965461 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5cddcf62-9925-4269-aa90-9ce40ceef544 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.252544 May 10 03:14:58.966302 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 68/121] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:58 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:59.009894 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-dad28b29-e83c-4037-b352-9321f73a0578 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:59.019322 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-dad28b29-e83c-4037-b352-9321f73a0578 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1515 microversion: 2.1 time: 0.364132 May 10 03:14:59.033081 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 54/122] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:58 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1515 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:59.039750 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-39ce152f-9c1c-4b41-be61-df05106914c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:59.040874 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-39ce152f-9c1c-4b41-be61-df05106914c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:59.053501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39ce152f-9c1c-4b41-be61-df05106914c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.053978 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39ce152f-9c1c-4b41-be61-df05106914c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.056080 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39ce152f-9c1c-4b41-be61-df05106914c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.056531 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39ce152f-9c1c-4b41-be61-df05106914c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.092781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-39ce152f-9c1c-4b41-be61-df05106914c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lazy-loading 'flavor' on Instance uuid c8c84baa-9dcf-42e3-bd13-d86cf6b59832 {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:14:59.310522 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-39ce152f-9c1c-4b41-be61-df05106914c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832/action" status: 200 len: 32 microversion: 2.1 time: 0.274951 May 10 03:14:59.311211 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 69/123] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:14:59 2022] POST /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:14:59.321710 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3812b0e6-96ad-48fa-b70e-47ee780eaf39 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:59.322321 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3812b0e6-96ad-48fa-b70e-47ee780eaf39 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:59.328829 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3812b0e6-96ad-48fa-b70e-47ee780eaf39 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.329284 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3812b0e6-96ad-48fa-b70e-47ee780eaf39 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.330313 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3812b0e6-96ad-48fa-b70e-47ee780eaf39 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.332020 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3812b0e6-96ad-48fa-b70e-47ee780eaf39 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.489590 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-511435d8-8c39-4578-bbe1-9ae28adc55fd req-d8fc3b91-9d78-40ea-8afb-1e40eec31f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f", "tag": "3ec8beef-b88c-43f8-8d89-f6c589198e59"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:59.509453 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-511435d8-8c39-4578-bbe1-9ae28adc55fd req-d8fc3b91-9d78-40ea-8afb-1e40eec31f91 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.510359 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-511435d8-8c39-4578-bbe1-9ae28adc55fd req-d8fc3b91-9d78-40ea-8afb-1e40eec31f91 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.526342 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-511435d8-8c39-4578-bbe1-9ae28adc55fd req-d8fc3b91-9d78-40ea-8afb-1e40eec31f91 service nova] Creating event network-changed:3ec8beef-b88c-43f8-8d89-f6c589198e59 for instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f on hv-cinder-83009 May 10 03:14:59.534137 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-511435d8-8c39-4578-bbe1-9ae28adc55fd req-d8fc3b91-9d78-40ea-8afb-1e40eec31f91 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049762 May 10 03:14:59.535121 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 70/124] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:59.575477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3812b0e6-96ad-48fa-b70e-47ee780eaf39 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:59.586612 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3812b0e6-96ad-48fa-b70e-47ee780eaf39 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.269474 May 10 03:14:59.587192 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 55/125] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:59 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:59.701982 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d7ddad6d-87d6-43f5-a9d2-7ee1730f23a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:59.702780 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d7ddad6d-87d6-43f5-a9d2-7ee1730f23a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:59.709365 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7ddad6d-87d6-43f5-a9d2-7ee1730f23a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.709827 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7ddad6d-87d6-43f5-a9d2-7ee1730f23a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.710849 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7ddad6d-87d6-43f5-a9d2-7ee1730f23a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.711415 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7ddad6d-87d6-43f5-a9d2-7ee1730f23a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.857177 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d7ddad6d-87d6-43f5-a9d2-7ee1730f23a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:59.867569 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d7ddad6d-87d6-43f5-a9d2-7ee1730f23a8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.169861 May 10 03:14:59.868183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 71/126] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:59 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:59.983184 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f2620cd7-4278-40bf-b853-9d210ee961c2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:59.983792 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f2620cd7-4278-40bf-b853-9d210ee961c2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:59.994568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f2620cd7-4278-40bf-b853-9d210ee961c2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.995558 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f2620cd7-4278-40bf-b853-9d210ee961c2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.996810 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f2620cd7-4278-40bf-b853-9d210ee961c2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.997239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f2620cd7-4278-40bf-b853-9d210ee961c2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:00.182218 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f2620cd7-4278-40bf-b853-9d210ee961c2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:00.191167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f2620cd7-4278-40bf-b853-9d210ee961c2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.211885 May 10 03:15:00.192043 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 56/127] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:14:59 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:00.574676 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-a16bfc27-5800-453b-b32d-d9432f1947d8 req-f7afb0f6-0c5b-45a4-b905-53e94aa91820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03eee221-c04f-48de-b2eb-5e696a377e0f", "name": "network-vif-plugged", "status": "completed", "tag": "240b8202-e12a-435e-ba1f-ff9f7b64c768"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:00.584364 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-a16bfc27-5800-453b-b32d-d9432f1947d8 req-f7afb0f6-0c5b-45a4-b905-53e94aa91820 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:00.585721 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-a16bfc27-5800-453b-b32d-d9432f1947d8 req-f7afb0f6-0c5b-45a4-b905-53e94aa91820 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:00.602185 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-a16bfc27-5800-453b-b32d-d9432f1947d8 req-f7afb0f6-0c5b-45a4-b905-53e94aa91820 service nova] Creating event network-vif-plugged:240b8202-e12a-435e-ba1f-ff9f7b64c768 for instance 03eee221-c04f-48de-b2eb-5e696a377e0f on hv-cinder-83009 May 10 03:15:00.605223 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-31c8d9ea-9cf1-4861-90c9-608929bda58c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:00.605843 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-31c8d9ea-9cf1-4861-90c9-608929bda58c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:00.607914 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-a16bfc27-5800-453b-b32d-d9432f1947d8 req-f7afb0f6-0c5b-45a4-b905-53e94aa91820 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036625 May 10 03:15:00.609223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 72/128] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:00.614404 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31c8d9ea-9cf1-4861-90c9-608929bda58c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:00.614404 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31c8d9ea-9cf1-4861-90c9-608929bda58c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:00.615054 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31c8d9ea-9cf1-4861-90c9-608929bda58c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:00.615490 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31c8d9ea-9cf1-4861-90c9-608929bda58c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:00.788004 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-31c8d9ea-9cf1-4861-90c9-608929bda58c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:00.801802 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-31c8d9ea-9cf1-4861-90c9-608929bda58c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.202069 May 10 03:15:00.802490 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 57/129] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:00 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:00.887448 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-427bc211-1d38-4385-bf32-9153605d76b5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:00.888999 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-427bc211-1d38-4385-bf32-9153605d76b5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:00.908095 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-427bc211-1d38-4385-bf32-9153605d76b5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:00.910604 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-427bc211-1d38-4385-bf32-9153605d76b5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:00.915356 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-427bc211-1d38-4385-bf32-9153605d76b5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:00.917239 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-427bc211-1d38-4385-bf32-9153605d76b5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:01.210604 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2099342a-e0a0-4730-9b1a-5aa164254a1f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:01.211374 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2099342a-e0a0-4730-9b1a-5aa164254a1f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:01.220343 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2099342a-e0a0-4730-9b1a-5aa164254a1f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:01.222189 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2099342a-e0a0-4730-9b1a-5aa164254a1f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:01.223641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2099342a-e0a0-4730-9b1a-5aa164254a1f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:01.224089 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2099342a-e0a0-4730-9b1a-5aa164254a1f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:01.245385 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-427bc211-1d38-4385-bf32-9153605d76b5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:01.255630 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-427bc211-1d38-4385-bf32-9153605d76b5 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.374375 May 10 03:15:01.256753 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 73/130] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:00 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:01.373979 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2099342a-e0a0-4730-9b1a-5aa164254a1f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:01.389189 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2099342a-e0a0-4730-9b1a-5aa164254a1f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.183808 May 10 03:15:01.389762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 58/131] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:01 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:01.821690 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-42a80e76-d79b-4421-a63c-77ce49feb1fe tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:01.822514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-42a80e76-d79b-4421-a63c-77ce49feb1fe tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:01.830503 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42a80e76-d79b-4421-a63c-77ce49feb1fe tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:01.830926 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42a80e76-d79b-4421-a63c-77ce49feb1fe tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:01.831700 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42a80e76-d79b-4421-a63c-77ce49feb1fe tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:01.832134 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42a80e76-d79b-4421-a63c-77ce49feb1fe tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:01.969584 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-42a80e76-d79b-4421-a63c-77ce49feb1fe tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:01.977467 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-42a80e76-d79b-4421-a63c-77ce49feb1fe tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.161066 May 10 03:15:01.978048 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 74/132] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:01 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:02.273383 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-25dd294a-dec7-42c6-9aee-14ce8ddba948 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:02.274057 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-25dd294a-dec7-42c6-9aee-14ce8ddba948 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:02.288075 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-25dd294a-dec7-42c6-9aee-14ce8ddba948 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:02.288526 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-25dd294a-dec7-42c6-9aee-14ce8ddba948 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:02.289336 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-25dd294a-dec7-42c6-9aee-14ce8ddba948 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:02.289887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-25dd294a-dec7-42c6-9aee-14ce8ddba948 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:02.405871 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d82438e7-7087-4157-9ef7-fa8b1c0cb2e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:02.407109 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d82438e7-7087-4157-9ef7-fa8b1c0cb2e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:02.416949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d82438e7-7087-4157-9ef7-fa8b1c0cb2e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:02.417805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d82438e7-7087-4157-9ef7-fa8b1c0cb2e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:02.418538 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d82438e7-7087-4157-9ef7-fa8b1c0cb2e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:02.419138 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d82438e7-7087-4157-9ef7-fa8b1c0cb2e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:02.453261 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-25dd294a-dec7-42c6-9aee-14ce8ddba948 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:02.466901 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-25dd294a-dec7-42c6-9aee-14ce8ddba948 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1360 microversion: 2.1 time: 0.197030 May 10 03:15:02.467902 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 59/133] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:02 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1360 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:02.584551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d82438e7-7087-4157-9ef7-fa8b1c0cb2e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:02.593803 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d82438e7-7087-4157-9ef7-fa8b1c0cb2e2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.191863 May 10 03:15:02.594593 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 75/134] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:02 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:02.765760 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bbb7a665-c9f8-4d87-abca-9e6cbe9e7c0c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:02.766268 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-bbb7a665-c9f8-4d87-abca-9e6cbe9e7c0c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:02.776344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bbb7a665-c9f8-4d87-abca-9e6cbe9e7c0c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:02.776828 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bbb7a665-c9f8-4d87-abca-9e6cbe9e7c0c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:02.778010 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bbb7a665-c9f8-4d87-abca-9e6cbe9e7c0c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:02.778739 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bbb7a665-c9f8-4d87-abca-9e6cbe9e7c0c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:02.808807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-bbb7a665-c9f8-4d87-abca-9e6cbe9e7c0c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:15:02.907545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-bbb7a665-c9f8-4d87-abca-9e6cbe9e7c0c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "DELETE /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 204 len: 0 microversion: 2.1 time: 0.146110 May 10 03:15:02.908272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 60/135] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:15:02 2022] DELETE /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:15:02.917884 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-43d7834c-41f3-460b-86b8-a949c39cfb1c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:02.919429 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-43d7834c-41f3-460b-86b8-a949c39cfb1c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:02.927926 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-43d7834c-41f3-460b-86b8-a949c39cfb1c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:02.928786 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-43d7834c-41f3-460b-86b8-a949c39cfb1c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:02.930065 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-43d7834c-41f3-460b-86b8-a949c39cfb1c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:02.930726 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-43d7834c-41f3-460b-86b8-a949c39cfb1c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:02.998838 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b04c0cd5-1c9b-409a-b4b6-19a318368c29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:03.000223 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b04c0cd5-1c9b-409a-b4b6-19a318368c29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:03.015268 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b04c0cd5-1c9b-409a-b4b6-19a318368c29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:03.016483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b04c0cd5-1c9b-409a-b4b6-19a318368c29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:03.018809 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b04c0cd5-1c9b-409a-b4b6-19a318368c29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:03.019753 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b04c0cd5-1c9b-409a-b4b6-19a318368c29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:03.146645 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-43d7834c-41f3-460b-86b8-a949c39cfb1c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:03.154438 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-43d7834c-41f3-460b-86b8-a949c39cfb1c tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1554 microversion: 2.1 time: 0.240764 May 10 03:15:03.157186 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 76/136] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:02 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:03.195829 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b04c0cd5-1c9b-409a-b4b6-19a318368c29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:03.203258 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b04c0cd5-1c9b-409a-b4b6-19a318368c29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.211429 May 10 03:15:03.204020 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 61/137] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:02 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:03.484398 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-01f59b3b-1078-4834-9d56-eec3038ffe32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:03.485098 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-01f59b3b-1078-4834-9d56-eec3038ffe32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:03.507269 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01f59b3b-1078-4834-9d56-eec3038ffe32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:03.507742 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01f59b3b-1078-4834-9d56-eec3038ffe32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:03.508623 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01f59b3b-1078-4834-9d56-eec3038ffe32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:03.509465 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01f59b3b-1078-4834-9d56-eec3038ffe32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:03.611263 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ea43a52c-4774-4051-a909-40ac6440937f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:03.612439 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ea43a52c-4774-4051-a909-40ac6440937f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:03.625622 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea43a52c-4774-4051-a909-40ac6440937f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:03.626079 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea43a52c-4774-4051-a909-40ac6440937f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:03.626873 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea43a52c-4774-4051-a909-40ac6440937f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:03.627388 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea43a52c-4774-4051-a909-40ac6440937f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:03.833473 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ea43a52c-4774-4051-a909-40ac6440937f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:03.840728 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ea43a52c-4774-4051-a909-40ac6440937f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.233541 May 10 03:15:03.841309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 62/138] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:03 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:03.860292 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-01f59b3b-1078-4834-9d56-eec3038ffe32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:03.869954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-01f59b3b-1078-4834-9d56-eec3038ffe32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1546 microversion: 2.1 time: 0.389197 May 10 03:15:03.883600 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 77/139] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:03 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1546 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:03.887313 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4a031146-ae91-4c35-b583-20e12db70ae7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:03.887827 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4a031146-ae91-4c35-b583-20e12db70ae7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:03.894867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4a031146-ae91-4c35-b583-20e12db70ae7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:03.895366 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4a031146-ae91-4c35-b583-20e12db70ae7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:03.896292 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4a031146-ae91-4c35-b583-20e12db70ae7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:03.898520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4a031146-ae91-4c35-b583-20e12db70ae7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:03.981406 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4a031146-ae91-4c35-b583-20e12db70ae7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097938 May 10 03:15:03.982013 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 63/140] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 10 03:15:03 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:04.174471 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ce9d621c-27ce-4538-8c44-ddd3cd6bc257 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:04.175301 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ce9d621c-27ce-4538-8c44-ddd3cd6bc257 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:04.181987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ce9d621c-27ce-4538-8c44-ddd3cd6bc257 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:04.182929 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ce9d621c-27ce-4538-8c44-ddd3cd6bc257 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:04.183984 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ce9d621c-27ce-4538-8c44-ddd3cd6bc257 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:04.184800 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ce9d621c-27ce-4538-8c44-ddd3cd6bc257 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:04.222199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-03a6bf76-c7cf-4c85-9e11-f79c611cb5bb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:04.222806 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-03a6bf76-c7cf-4c85-9e11-f79c611cb5bb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:04.230667 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-03a6bf76-c7cf-4c85-9e11-f79c611cb5bb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:04.231106 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-03a6bf76-c7cf-4c85-9e11-f79c611cb5bb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:04.231881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-03a6bf76-c7cf-4c85-9e11-f79c611cb5bb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:04.232316 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-03a6bf76-c7cf-4c85-9e11-f79c611cb5bb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:04.510879 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-03a6bf76-c7cf-4c85-9e11-f79c611cb5bb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:04.515437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ce9d621c-27ce-4538-8c44-ddd3cd6bc257 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:04.519081 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-03a6bf76-c7cf-4c85-9e11-f79c611cb5bb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.301431 May 10 03:15:04.528098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 64/141] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:04 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:04.528264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ce9d621c-27ce-4538-8c44-ddd3cd6bc257 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1554 microversion: 2.1 time: 0.353806 May 10 03:15:04.528264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 78/142] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:04 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1554 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:04.862111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f04998dc-b75d-4996-b9a7-ebf9c7f6229c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:04.862111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f04998dc-b75d-4996-b9a7-ebf9c7f6229c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:04.866755 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f04998dc-b75d-4996-b9a7-ebf9c7f6229c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:04.867528 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f04998dc-b75d-4996-b9a7-ebf9c7f6229c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:04.868219 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f04998dc-b75d-4996-b9a7-ebf9c7f6229c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:04.868909 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f04998dc-b75d-4996-b9a7-ebf9c7f6229c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.204053 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f04998dc-b75d-4996-b9a7-ebf9c7f6229c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:05.213823 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f04998dc-b75d-4996-b9a7-ebf9c7f6229c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1368 microversion: 2.1 time: 0.358439 May 10 03:15:05.218340 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 65/143] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:04 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1368 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:05.539697 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f2ce7543-5cbe-422f-a1c5-96f9b91b2951 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:05.540448 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f2ce7543-5cbe-422f-a1c5-96f9b91b2951 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:05.542382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2873db67-f7e5-4a31-b647-3daaa6e57637 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:05.543219 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2873db67-f7e5-4a31-b647-3daaa6e57637 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:05.554541 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f2ce7543-5cbe-422f-a1c5-96f9b91b2951 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:05.556120 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f2ce7543-5cbe-422f-a1c5-96f9b91b2951 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.556414 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2873db67-f7e5-4a31-b647-3daaa6e57637 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:05.557104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2873db67-f7e5-4a31-b647-3daaa6e57637 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.559474 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f2ce7543-5cbe-422f-a1c5-96f9b91b2951 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:05.559984 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f2ce7543-5cbe-422f-a1c5-96f9b91b2951 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.560645 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2873db67-f7e5-4a31-b647-3daaa6e57637 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:05.561204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2873db67-f7e5-4a31-b647-3daaa6e57637 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.771174 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2873db67-f7e5-4a31-b647-3daaa6e57637 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:05.773228 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f2ce7543-5cbe-422f-a1c5-96f9b91b2951 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:05.785219 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2873db67-f7e5-4a31-b647-3daaa6e57637 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1554 microversion: 2.1 time: 0.245287 May 10 03:15:05.796092 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 66/144] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:05 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1554 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:05.799410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f2ce7543-5cbe-422f-a1c5-96f9b91b2951 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.266578 May 10 03:15:05.800216 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 79/145] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:05 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:05.803098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-2e6def28-0308-4ee9-b21a-ba711ab33bd9 req-5bb2dcf0-5494-41a8-a46c-d9782de5356f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03eee221-c04f-48de-b2eb-5e696a377e0f", "tag": "240b8202-e12a-435e-ba1f-ff9f7b64c768"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:05.825950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-2e6def28-0308-4ee9-b21a-ba711ab33bd9 req-5bb2dcf0-5494-41a8-a46c-d9782de5356f service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:05.828103 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-2e6def28-0308-4ee9-b21a-ba711ab33bd9 req-5bb2dcf0-5494-41a8-a46c-d9782de5356f service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.856216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-2e6def28-0308-4ee9-b21a-ba711ab33bd9 req-5bb2dcf0-5494-41a8-a46c-d9782de5356f service nova] Creating event network-changed:240b8202-e12a-435e-ba1f-ff9f7b64c768 for instance 03eee221-c04f-48de-b2eb-5e696a377e0f on hv-cinder-83009 May 10 03:15:05.866003 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-2e6def28-0308-4ee9-b21a-ba711ab33bd9 req-5bb2dcf0-5494-41a8-a46c-d9782de5356f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068286 May 10 03:15:05.866668 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 67/146] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:06.236310 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f2602940-b916-437b-9143-5390982a9a9b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:06.237234 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f2602940-b916-437b-9143-5390982a9a9b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:06.253936 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f2602940-b916-437b-9143-5390982a9a9b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.254326 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f2602940-b916-437b-9143-5390982a9a9b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:06.255421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f2602940-b916-437b-9143-5390982a9a9b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.255865 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f2602940-b916-437b-9143-5390982a9a9b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:06.452965 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f2602940-b916-437b-9143-5390982a9a9b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:06.463562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f2602940-b916-437b-9143-5390982a9a9b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1556 microversion: 2.1 time: 0.233549 May 10 03:15:06.464245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 80/147] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:06 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1556 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:06.481695 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d3f9f074-d44f-4ade-a213-5db684de356a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:06.482529 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d3f9f074-d44f-4ade-a213-5db684de356a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:06.489982 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d3f9f074-d44f-4ade-a213-5db684de356a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.490797 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d3f9f074-d44f-4ade-a213-5db684de356a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:06.492044 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d3f9f074-d44f-4ade-a213-5db684de356a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.492630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d3f9f074-d44f-4ade-a213-5db684de356a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:06.599183 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d3f9f074-d44f-4ade-a213-5db684de356a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121407 May 10 03:15:06.606647 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 68/148] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 10 03:15:06 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:06.805830 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d2a1597c-ae46-4c70-9976-9c2342a41dfd tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:06.806539 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d2a1597c-ae46-4c70-9976-9c2342a41dfd tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:06.816975 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5ff1036b-7dcb-4989-9553-dc0269c675b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:06.817923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5ff1036b-7dcb-4989-9553-dc0269c675b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:06.820267 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d2a1597c-ae46-4c70-9976-9c2342a41dfd tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.821486 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d2a1597c-ae46-4c70-9976-9c2342a41dfd tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:06.822485 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d2a1597c-ae46-4c70-9976-9c2342a41dfd tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.823382 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d2a1597c-ae46-4c70-9976-9c2342a41dfd tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:06.824418 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ff1036b-7dcb-4989-9553-dc0269c675b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.825307 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ff1036b-7dcb-4989-9553-dc0269c675b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:06.826143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ff1036b-7dcb-4989-9553-dc0269c675b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.826641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ff1036b-7dcb-4989-9553-dc0269c675b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:07.252427 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5ff1036b-7dcb-4989-9553-dc0269c675b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:07.265162 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5ff1036b-7dcb-4989-9553-dc0269c675b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.452342 May 10 03:15:07.265888 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 69/149] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:06 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:15:07.613594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d2a1597c-ae46-4c70-9976-9c2342a41dfd tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:07.624336 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d2a1597c-ae46-4c70-9976-9c2342a41dfd tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1554 microversion: 2.1 time: 0.825393 May 10 03:15:07.624957 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 81/150] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:06 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1554 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:07.972928 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-c3596c63-70b9-46dc-ad3b-2cf51d81d797 req-14b5e3e1-f94c-47c1-8e6a-ac4deada7503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e867a0c9-e715-4ac3-8be5-1bb4e64f56fb", "tag": "ca4610dc-9a2b-4dfa-a722-526e08fec54d"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:07.995004 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-c3596c63-70b9-46dc-ad3b-2cf51d81d797 req-14b5e3e1-f94c-47c1-8e6a-ac4deada7503 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:07.995004 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-c3596c63-70b9-46dc-ad3b-2cf51d81d797 req-14b5e3e1-f94c-47c1-8e6a-ac4deada7503 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:08.009828 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-c3596c63-70b9-46dc-ad3b-2cf51d81d797 req-14b5e3e1-f94c-47c1-8e6a-ac4deada7503 service nova] Creating event network-changed:ca4610dc-9a2b-4dfa-a722-526e08fec54d for instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb on hv-cinder-83009 May 10 03:15:08.014989 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-c3596c63-70b9-46dc-ad3b-2cf51d81d797 req-14b5e3e1-f94c-47c1-8e6a-ac4deada7503 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046185 May 10 03:15:08.016029 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 70/151] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:08.262598 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-cedf5379-08b5-47cc-b721-ebc3ea065d15 req-d97af3d8-2376-424c-995d-35196cf179ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364eff63-27a1-4e99-bb61-81ac36f72973", "name": "network-vif-deleted", "tag": "1250bf8e-004a-44ae-a5a9-5013188a9085"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:08.271816 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-cedf5379-08b5-47cc-b721-ebc3ea065d15 req-d97af3d8-2376-424c-995d-35196cf179ce service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:08.272264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-cedf5379-08b5-47cc-b721-ebc3ea065d15 req-d97af3d8-2376-424c-995d-35196cf179ce service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:08.283453 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-cedf5379-08b5-47cc-b721-ebc3ea065d15 req-d97af3d8-2376-424c-995d-35196cf179ce service nova] Creating event network-vif-deleted:1250bf8e-004a-44ae-a5a9-5013188a9085 for instance 364eff63-27a1-4e99-bb61-81ac36f72973 on hv-cinder-83009 May 10 03:15:08.285883 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4b5c65d8-68d1-4dde-a3f3-91afe0505e4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:08.287166 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4b5c65d8-68d1-4dde-a3f3-91afe0505e4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:08.288589 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-cedf5379-08b5-47cc-b721-ebc3ea065d15 req-d97af3d8-2376-424c-995d-35196cf179ce service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029748 May 10 03:15:08.289221 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 82/152] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:08.294547 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b5c65d8-68d1-4dde-a3f3-91afe0505e4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:08.295083 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b5c65d8-68d1-4dde-a3f3-91afe0505e4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:08.295870 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b5c65d8-68d1-4dde-a3f3-91afe0505e4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:08.296309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b5c65d8-68d1-4dde-a3f3-91afe0505e4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:08.426458 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4b5c65d8-68d1-4dde-a3f3-91afe0505e4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:08.434025 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4b5c65d8-68d1-4dde-a3f3-91afe0505e4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.154640 May 10 03:15:08.443943 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 71/153] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:08 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:15:08.642717 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-16554bf5-4a09-4740-8be2-a0bc7ededd93 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:08.643899 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-16554bf5-4a09-4740-8be2-a0bc7ededd93 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:08.651122 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-16554bf5-4a09-4740-8be2-a0bc7ededd93 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:08.651770 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-16554bf5-4a09-4740-8be2-a0bc7ededd93 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:08.652535 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-16554bf5-4a09-4740-8be2-a0bc7ededd93 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:08.653136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-16554bf5-4a09-4740-8be2-a0bc7ededd93 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:08.723451 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-16554bf5-4a09-4740-8be2-a0bc7ededd93 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:08.731560 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-16554bf5-4a09-4740-8be2-a0bc7ededd93 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1512 microversion: 2.1 time: 0.093014 May 10 03:15:08.732219 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 83/154] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:08 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:09.451289 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e662a28b-e491-462e-8bc1-cb0ea2e94bde tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:09.451948 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e662a28b-e491-462e-8bc1-cb0ea2e94bde tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:09.459340 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e662a28b-e491-462e-8bc1-cb0ea2e94bde tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:09.459822 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e662a28b-e491-462e-8bc1-cb0ea2e94bde tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:09.460571 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e662a28b-e491-462e-8bc1-cb0ea2e94bde tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:09.461566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e662a28b-e491-462e-8bc1-cb0ea2e94bde tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:09.591594 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e662a28b-e491-462e-8bc1-cb0ea2e94bde tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:09.599609 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e662a28b-e491-462e-8bc1-cb0ea2e94bde tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.152254 May 10 03:15:09.600169 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 72/155] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:09 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:09.749186 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6cec9ce9-da61-4395-af1a-70b549a1971f tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:09.749945 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6cec9ce9-da61-4395-af1a-70b549a1971f tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:09.757607 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6cec9ce9-da61-4395-af1a-70b549a1971f tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:09.758072 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6cec9ce9-da61-4395-af1a-70b549a1971f tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:09.758851 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6cec9ce9-da61-4395-af1a-70b549a1971f tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:09.759301 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6cec9ce9-da61-4395-af1a-70b549a1971f tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:09.822412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6cec9ce9-da61-4395-af1a-70b549a1971f tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:09.830903 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6cec9ce9-da61-4395-af1a-70b549a1971f tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1512 microversion: 2.1 time: 0.085611 May 10 03:15:09.831502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 84/156] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:09 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1512 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:10.617143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2c81ea8f-2a50-44b7-9daf-d8fc1d5623e7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:10.617760 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2c81ea8f-2a50-44b7-9daf-d8fc1d5623e7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:10.624107 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2c81ea8f-2a50-44b7-9daf-d8fc1d5623e7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:10.624696 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2c81ea8f-2a50-44b7-9daf-d8fc1d5623e7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:10.625564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2c81ea8f-2a50-44b7-9daf-d8fc1d5623e7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:10.626098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2c81ea8f-2a50-44b7-9daf-d8fc1d5623e7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:10.759786 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2c81ea8f-2a50-44b7-9daf-d8fc1d5623e7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:10.767094 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2c81ea8f-2a50-44b7-9daf-d8fc1d5623e7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.153965 May 10 03:15:10.768986 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 73/157] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:10 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:10.848354 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-11465f60-619d-44d6-b089-90e5b92c1f14 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:10.849110 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-11465f60-619d-44d6-b089-90e5b92c1f14 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:10.855315 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-11465f60-619d-44d6-b089-90e5b92c1f14 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:10.855820 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-11465f60-619d-44d6-b089-90e5b92c1f14 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:10.857264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-11465f60-619d-44d6-b089-90e5b92c1f14 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:10.857933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-11465f60-619d-44d6-b089-90e5b92c1f14 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:10.995226 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-11465f60-619d-44d6-b089-90e5b92c1f14 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb881a37e3a46538ddee06f510c7fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b83406e874fcea2e81894d366f353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:11.003721 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-11465f60-619d-44d6-b089-90e5b92c1f14 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 200 len: 1346 microversion: 2.1 time: 0.160356 May 10 03:15:11.004298 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 85/158] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:10 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 1346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:11.785278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fdd1b97e-ae10-4ac0-b790-1c87b5b75a1d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:11.786396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fdd1b97e-ae10-4ac0-b790-1c87b5b75a1d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:11.799295 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fdd1b97e-ae10-4ac0-b790-1c87b5b75a1d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:11.804597 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fdd1b97e-ae10-4ac0-b790-1c87b5b75a1d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:11.805650 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fdd1b97e-ae10-4ac0-b790-1c87b5b75a1d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:11.807187 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fdd1b97e-ae10-4ac0-b790-1c87b5b75a1d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:12.026209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:12.029291 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:12.093181 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-fdd1b97e-ae10-4ac0-b790-1c87b5b75a1d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:12.101432 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:12.105880 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fdd1b97e-ae10-4ac0-b790-1c87b5b75a1d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.324539 May 10 03:15:12.106204 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:12.108277 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 74/159] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:11 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:12.110563 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:12.113809 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:12.168989 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] HTTP exception thrown: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Request method failure captured: May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 HTTP/1.1 May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedh_4cFNeYUaT_B6pp21VJ1-QDW1NA_n3F8y4Jx6N6ynhQv1x8Nh7SHWzE3L_LKZz995WD9t4MOxm33Xh1y5gxT3uKuJarjbFNNktdpg3cglHhyxExYAJYhxNOKCkIkgxyCl1w6iDwNfgfroVome4fHnEin9to4AriZo_ohfFW6gQwk May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 857b83406e874fcea2e81894d366f353 May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:15:12.175962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/857b83406e874fcea2e81894d366f353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/857b83406e874fcea2e81894d366f353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_857b83406e874fcea2e81894d366f353", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/857b83406e874fcea2e81894d366f353"}]}] May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 857b83406e874fcea2e81894d366f353 May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-DeleteServersTestJSON-1930368145-project May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 6fb881a37e3a46538ddee06f510c7fa2 May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-DeleteServersTestJSON-1930368145-project May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.177230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '364eff63-27a1-4e99-bb61-81ac36f72973'} May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:12.177913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.179001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:12.181980 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Returning 404 to user: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:12.183019 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d4b69c2d-b344-43b7-9e53-009cf9d7f781 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 404 len: 111 microversion: 2.1 time: 0.165955 May 10 03:15:12.187589 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 86/160] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:12 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:15:12.323775 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:12.325068 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:12.331830 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:12.332792 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:12.333798 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:12.334438 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:12.365631 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] HTTP exception thrown: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Request method failure captured: May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973/os-volume_attachments HTTP/1.1 May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedh_4cFNeYUaT_B6pp21VJ1-QDW1NA_n3F8y4Jx6N6ynhQv1x8Nh7SHWzE3L_LKZz995WD9t4MOxm33Xh1y5gxT3uKuJarjbFNNktdpg3cglHhyxExYAJYhxNOKCkIkgxyCl1w6iDwNfgfroVome4fHnEin9to4AriZo_ohfFW6gQwk May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 857b83406e874fcea2e81894d366f353 May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:15:12.380602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/857b83406e874fcea2e81894d366f353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/857b83406e874fcea2e81894d366f353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_857b83406e874fcea2e81894d366f353", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/857b83406e874fcea2e81894d366f353"}]}] May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 857b83406e874fcea2e81894d366f353 May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-DeleteServersTestJSON-1930368145-project May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 6fb881a37e3a46538ddee06f510c7fa2 May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-DeleteServersTestJSON-1930368145-project May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.381762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'server_id': '364eff63-27a1-4e99-bb61-81ac36f72973'} May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:12.382417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:12.383457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:12.387985 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Returning 404 to user: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:12.393675 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-61a7ad57-8b1e-4c3a-9b67-0071dc2f4a0a tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073825 May 10 03:15:12.396817 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 75/161] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:15:12 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:15:13.125554 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3a6b3c4d-8afb-4755-a03b-42e13d9aaa49 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:13.126177 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3a6b3c4d-8afb-4755-a03b-42e13d9aaa49 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:13.133062 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3a6b3c4d-8afb-4755-a03b-42e13d9aaa49 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:13.133507 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3a6b3c4d-8afb-4755-a03b-42e13d9aaa49 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:13.134277 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3a6b3c4d-8afb-4755-a03b-42e13d9aaa49 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:13.134707 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3a6b3c4d-8afb-4755-a03b-42e13d9aaa49 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:13.266449 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3a6b3c4d-8afb-4755-a03b-42e13d9aaa49 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:13.273979 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3a6b3c4d-8afb-4755-a03b-42e13d9aaa49 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.152147 May 10 03:15:13.274660 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 87/162] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:13 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:13.621974 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:13.622476 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:13.629249 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:13.629969 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:13.630762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:13.631165 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:13.645873 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] HTTP exception thrown: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Request method failure captured: May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: DELETE /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 HTTP/1.1 May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedh_4cFNeYUaT_B6pp21VJ1-QDW1NA_n3F8y4Jx6N6ynhQv1x8Nh7SHWzE3L_LKZz995WD9t4MOxm33Xh1y5gxT3uKuJarjbFNNktdpg3cglHhyxExYAJYhxNOKCkIkgxyCl1w6iDwNfgfroVome4fHnEin9to4AriZo_ohfFW6gQwk May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 857b83406e874fcea2e81894d366f353 May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:15:13.648272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/857b83406e874fcea2e81894d366f353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/857b83406e874fcea2e81894d366f353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_857b83406e874fcea2e81894d366f353", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/857b83406e874fcea2e81894d366f353"}]}] May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 857b83406e874fcea2e81894d366f353 May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-DeleteServersTestJSON-1930368145-project May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 6fb881a37e3a46538ddee06f510c7fa2 May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-DeleteServersTestJSON-1930368145-project May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.649708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '364eff63-27a1-4e99-bb61-81ac36f72973'} May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:13.658424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.659995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:13.661298 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Returning 404 to user: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:13.661298 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-639ff126-291b-4f55-bd2c-eb0e8dfb5650 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "DELETE /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 404 len: 111 microversion: 2.1 time: 0.032542 May 10 03:15:13.661298 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 76/163] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:15:13 2022] DELETE /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:15:13.661490 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:13.661490 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] [instance: 364eff63-27a1-4e99-bb61-81ac36f72973] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:13.666048 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:13.666498 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:13.667265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:13.667700 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:13.680646 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] HTTP exception thrown: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Request method failure captured: May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 HTTP/1.1 May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedh_4cFNeYUaT_B6pp21VJ1-QDW1NA_n3F8y4Jx6N6ynhQv1x8Nh7SHWzE3L_LKZz995WD9t4MOxm33Xh1y5gxT3uKuJarjbFNNktdpg3cglHhyxExYAJYhxNOKCkIkgxyCl1w6iDwNfgfroVome4fHnEin9to4AriZo_ohfFW6gQwk May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 857b83406e874fcea2e81894d366f353 May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:15:13.682196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/857b83406e874fcea2e81894d366f353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/857b83406e874fcea2e81894d366f353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_857b83406e874fcea2e81894d366f353", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/857b83406e874fcea2e81894d366f353"}]}] May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 857b83406e874fcea2e81894d366f353 May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930368145 May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-DeleteServersTestJSON-1930368145-project May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 6fb881a37e3a46538ddee06f510c7fa2 May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-DeleteServersTestJSON-1930368145-project May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.683514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '364eff63-27a1-4e99-bb61-81ac36f72973'} May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:13.684844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. May 10 03:15:13.686135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:13.687263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] Returning 404 to user: Instance 364eff63-27a1-4e99-bb61-81ac36f72973 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:13.687263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-dbd0578b-1f99-41af-8408-01955c7b6283 tempest-DeleteServersTestJSON-1930368145 tempest-DeleteServersTestJSON-1930368145-project] 10.222.0.55 "GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973" status: 404 len: 111 microversion: 2.1 time: 0.028828 May 10 03:15:13.687263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 88/164] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:13 2022] GET /compute/v2.1/servers/364eff63-27a1-4e99-bb61-81ac36f72973 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:15:14.292142 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-05b7ca51-2a3d-4b3b-b304-d0c4d018c1d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:14.292976 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-05b7ca51-2a3d-4b3b-b304-d0c4d018c1d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:14.301080 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-05b7ca51-2a3d-4b3b-b304-d0c4d018c1d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:14.301538 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-05b7ca51-2a3d-4b3b-b304-d0c4d018c1d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:14.302335 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-05b7ca51-2a3d-4b3b-b304-d0c4d018c1d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:14.302763 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-05b7ca51-2a3d-4b3b-b304-d0c4d018c1d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:14.744195 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-05b7ca51-2a3d-4b3b-b304-d0c4d018c1d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:14.757168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-05b7ca51-2a3d-4b3b-b304-d0c4d018c1d2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.468824 May 10 03:15:14.758080 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 77/165] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:14 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:15:15.774275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2699fb77-6561-4043-8b70-f5b82b7cf2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:15.774896 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2699fb77-6561-4043-8b70-f5b82b7cf2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:15.782024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2699fb77-6561-4043-8b70-f5b82b7cf2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:15.782807 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2699fb77-6561-4043-8b70-f5b82b7cf2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:15.783873 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2699fb77-6561-4043-8b70-f5b82b7cf2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:15.784505 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2699fb77-6561-4043-8b70-f5b82b7cf2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:15.920734 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2699fb77-6561-4043-8b70-f5b82b7cf2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:15.933918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2699fb77-6561-4043-8b70-f5b82b7cf2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.163455 May 10 03:15:15.934741 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 89/166] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:15 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:16.219463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-81dd96d9-a3b9-49e2-b888-2a17b5b00ba0 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Action: 'create', calling method: .version_select at 0x7f14a50c5040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-854949857", "metadata": {"Type": "work"}}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-81dd96d9-a3b9-49e2-b888-2a17b5b00ba0 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Request method failure captured: May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 121 May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedjDGcCp6bE8G7Ei1Y_VofKyFLr4HsrAmDV7JyZDAZ1EX1YGeVW_txczEKvgAnY8kNheHyAgAwnHqu4DjgJJZSL6-V4vIh3leVP8v8dHvHamCsoEQnhcZQU7ZJvpWvi2Tp-uVUOi0-5YHwcO-sskN0V33zt0FfVEfA73kd6JhLxAou4 May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:15:16.241509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5636293a7a474103ab433dbbdcdaee54", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5636293a7a474103ab433dbbdcdaee54"}]}] May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: f6ad87f11bb64060b2267b2e4216d946 May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-854949857", "metadata": {"Type": "work"}}} May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: May 10 03:15:16.244921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-854949857', 'metadata': {'Type': 'work'}}}} May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise error May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi '#$%' May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:16.245632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 03:15:16.246804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 03:15:16.249151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 03:15:16.249151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.249151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-81dd96d9-a3b9-49e2-b888-2a17b5b00ba0 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:16.249151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-81dd96d9-a3b9-49e2-b888-2a17b5b00ba0 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.310555 May 10 03:15:16.261821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3c27e2b8-efe3-4768-a168-a1c46d65e94b tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Action: 'create', calling method: .version_select at 0x7f1497ff3d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1027540606", "metadata": {"Type": "work"}}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:16.263442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 78/167] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 10 03:15:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3c27e2b8-efe3-4768-a168-a1c46d65e94b tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Request method failure captured: May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 120 May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedjDGcCp6bE8G7Ei1Y_VofKyFLr4HsrAmDV7JyZDAZ1EX1YGeVW_txczEKvgAnY8kNheHyAgAwnHqu4DjgJJZSL6-V4vIh3leVP8v8dHvHamCsoEQnhcZQU7ZJvpWvi2Tp-uVUOi0-5YHwcO-sskN0V33zt0FfVEfA73kd6JhLxAou4 May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:15:16.265661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5636293a7a474103ab433dbbdcdaee54", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5636293a7a474103ab433dbbdcdaee54"}]}] May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: f6ad87f11bb64060b2267b2e4216d946 May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1027540606", "metadata": {"Type": "work"}}} May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: May 10 03:15:16.267946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1027540606', 'metadata': {'Type': 'work'}}}} May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise error May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi '0' May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:16.268805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 03:15:16.269963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 03:15:16.271011 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 03:15:16.271011 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.271011 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3c27e2b8-efe3-4768-a168-a1c46d65e94b tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:16.286735 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3c27e2b8-efe3-4768-a168-a1c46d65e94b tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028330 May 10 03:15:16.287889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 90/168] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 10 03:15:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:15:16.299056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9ef71f68-daeb-4ac6-bedd-eb40f487780f tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Action: 'create', calling method: .version_select at 0x7f14a506e820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-766820576", "metadata": {"Type": "work"}}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9ef71f68-daeb-4ac6-bedd-eb40f487780f tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Request method failure captured: May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 118 May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedjDGcCp6bE8G7Ei1Y_VofKyFLr4HsrAmDV7JyZDAZ1EX1YGeVW_txczEKvgAnY8kNheHyAgAwnHqu4DjgJJZSL6-V4vIh3leVP8v8dHvHamCsoEQnhcZQU7ZJvpWvi2Tp-uVUOi0-5YHwcO-sskN0V33zt0FfVEfA73kd6JhLxAou4 May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:15:16.301463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5636293a7a474103ab433dbbdcdaee54", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5636293a7a474103ab433dbbdcdaee54"}]}] May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: f6ad87f11bb64060b2267b2e4216d946 May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-766820576", "metadata": {"Type": "work"}}} May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: May 10 03:15:16.302545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-766820576', 'metadata': {'Type': 'work'}}}} May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise error May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi '' May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:16.303239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 03:15:16.304409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 03:15:16.305803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 03:15:16.305803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.305803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9ef71f68-daeb-4ac6-bedd-eb40f487780f tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:16.305803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9ef71f68-daeb-4ac6-bedd-eb40f487780f tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008032 May 10 03:15:16.305803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 79/169] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 10 03:15:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:15:16.314524 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cd17d2ea-4eab-49ac-a3e0-150f1187604a tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Calling method '.version_select at 0x7f1497fee040>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:16.350952 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-cd17d2ea-4eab-49ac-a3e0-150f1187604a tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] HTTP exception thrown: Volume tempest-invalid-1354923028 could not be found. May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cd17d2ea-4eab-49ac-a3e0-150f1187604a tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Request method failure captured: May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1354923028 HTTP/1.1 May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedjDGcCp6bE8G7Ei1Y_VofKyFLr4HsrAmDV7JyZDAZ1EX1YGeVW_txczEKvgAnY8kNheHyAgAwnHqu4DjgJJZSL6-V4vIh3leVP8v8dHvHamCsoEQnhcZQU7ZJvpWvi2Tp-uVUOi0-5YHwcO-sskN0V33zt0FfVEfA73kd6JhLxAou4 May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:15:16.353934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5636293a7a474103ab433dbbdcdaee54", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5636293a7a474103ab433dbbdcdaee54"}]}] May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: f6ad87f11bb64060b2267b2e4216d946 May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Volume tempest-invalid-1354923028 could not be found. May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': 'tempest-invalid-1354923028'} May 10 03:15:16.355075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1354923028 could not be found. (HTTP 404) (Request-ID: req-e0f339aa-e910-4696-9cb7-4268615bac4f) May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.355740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:15:16.356765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1354923028 could not be found. May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:15:16.357868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1354923028 could not be found. May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1354923028 could not be found. May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cd17d2ea-4eab-49ac-a3e0-150f1187604a tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Returning 404 to user: Volume tempest-invalid-1354923028 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-cd17d2ea-4eab-49ac-a3e0-150f1187604a tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1354923028" status: 404 len: 99 microversion: 2.1 time: 0.046145 May 10 03:15:16.358918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 91/170] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 10 03:15:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1354923028 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 03:15:16.370468 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b83f40be-d484-4b0c-a7b5-6eb28a53ab0a tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005234 May 10 03:15:16.376359 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 80/171] 10.222.0.55 () {58 vars in 1139 bytes} [Tue May 10 03:15:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 03:15:16.382983 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9c3647d6-5a56-415f-88ab-dc87d6533860 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004858 May 10 03:15:16.384012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 92/172] 10.222.0.55 () {58 vars in 1136 bytes} [Tue May 10 03:15:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 10 03:15:16.399629 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7c709d7a-28b7-4483-a941-bb0aef5521d3 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Calling method '.version_select at 0x7f14a506ea60>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:16.438230 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-7c709d7a-28b7-4483-a941-bb0aef5521d3 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] HTTP exception thrown: Volume 8d02a0e4-1a20-47c4-bd19-260c6f96dc99 could not be found. May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7c709d7a-28b7-4483-a941-bb0aef5521d3 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Request method failure captured: May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: DELETE /compute/v2.1/os-volumes/8d02a0e4-1a20-47c4-bd19-260c6f96dc99 HTTP/1.1 May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedjDGcCp6bE8G7Ei1Y_VofKyFLr4HsrAmDV7JyZDAZ1EX1YGeVW_txczEKvgAnY8kNheHyAgAwnHqu4DjgJJZSL6-V4vIh3leVP8v8dHvHamCsoEQnhcZQU7ZJvpWvi2Tp-uVUOi0-5YHwcO-sskN0V33zt0FfVEfA73kd6JhLxAou4 May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:15:16.441072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5636293a7a474103ab433dbbdcdaee54", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5636293a7a474103ab433dbbdcdaee54"}]}] May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: f6ad87f11bb64060b2267b2e4216d946 May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Volume 8d02a0e4-1a20-47c4-bd19-260c6f96dc99 could not be found. May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '8d02a0e4-1a20-47c4-bd19-260c6f96dc99'} May 10 03:15:16.442211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d02a0e4-1a20-47c4-bd19-260c6f96dc99 could not be found. (HTTP 404) (Request-ID: req-c00d64e2-47e3-4226-982c-8bf2d8a49532) May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.442917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:15:16.443903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d02a0e4-1a20-47c4-bd19-260c6f96dc99 could not be found. May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 03:15:16.444910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d02a0e4-1a20-47c4-bd19-260c6f96dc99 could not be found. May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d02a0e4-1a20-47c4-bd19-260c6f96dc99 could not be found. May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7c709d7a-28b7-4483-a941-bb0aef5521d3 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Returning 404 to user: Volume 8d02a0e4-1a20-47c4-bd19-260c6f96dc99 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7c709d7a-28b7-4483-a941-bb0aef5521d3 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/8d02a0e4-1a20-47c4-bd19-260c6f96dc99" status: 404 len: 109 microversion: 2.1 time: 0.053370 May 10 03:15:16.448222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 81/173] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:15:16 2022] DELETE /compute/v2.1/os-volumes/8d02a0e4-1a20-47c4-bd19-260c6f96dc99 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:15:16.455129 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-118326b4-ffc7-4ef6-88c5-8429d57ffaf9 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Calling method '.version_select at 0x7f14a4138280>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:16.488691 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-118326b4-ffc7-4ef6-88c5-8429d57ffaf9 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] HTTP exception thrown: Volume 1b1c27a5-894e-4409-88ba-5114aa46aacb could not be found. May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-118326b4-ffc7-4ef6-88c5-8429d57ffaf9 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Request method failure captured: May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/os-volumes/1b1c27a5-894e-4409-88ba-5114aa46aacb HTTP/1.1 May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedjDGcCp6bE8G7Ei1Y_VofKyFLr4HsrAmDV7JyZDAZ1EX1YGeVW_txczEKvgAnY8kNheHyAgAwnHqu4DjgJJZSL6-V4vIh3leVP8v8dHvHamCsoEQnhcZQU7ZJvpWvi2Tp-uVUOi0-5YHwcO-sskN0V33zt0FfVEfA73kd6JhLxAou4 May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:15:16.491190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5636293a7a474103ab433dbbdcdaee54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5636293a7a474103ab433dbbdcdaee54", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5636293a7a474103ab433dbbdcdaee54"}]}] May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5636293a7a474103ab433dbbdcdaee54 May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-VolumesNegativeTest-1658228139 May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: f6ad87f11bb64060b2267b2e4216d946 May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-VolumesNegativeTest-1658228139-project May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Volume 1b1c27a5-894e-4409-88ba-5114aa46aacb could not be found. May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '1b1c27a5-894e-4409-88ba-5114aa46aacb'} May 10 03:15:16.492355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b1c27a5-894e-4409-88ba-5114aa46aacb could not be found. (HTTP 404) (Request-ID: req-286af57d-a044-4b61-95b3-d9d61367f9bf) May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.493093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:15:16.494092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b1c27a5-894e-4409-88ba-5114aa46aacb could not be found. May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 03:15:16.495052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b1c27a5-894e-4409-88ba-5114aa46aacb could not be found. May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b1c27a5-894e-4409-88ba-5114aa46aacb could not be found. May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-118326b4-ffc7-4ef6-88c5-8429d57ffaf9 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] Returning 404 to user: Volume 1b1c27a5-894e-4409-88ba-5114aa46aacb could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-118326b4-ffc7-4ef6-88c5-8429d57ffaf9 tempest-VolumesNegativeTest-1658228139 tempest-VolumesNegativeTest-1658228139-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/1b1c27a5-894e-4409-88ba-5114aa46aacb" status: 404 len: 109 microversion: 2.1 time: 0.042194 May 10 03:15:16.496026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 93/174] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:15:16 2022] GET /compute/v2.1/os-volumes/1b1c27a5-894e-4409-88ba-5114aa46aacb => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:15:16.960577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-857344d1-fb40-4b05-8330-87f0f6622915 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:16.961327 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-857344d1-fb40-4b05-8330-87f0f6622915 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:16.970504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-857344d1-fb40-4b05-8330-87f0f6622915 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:16.971266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-857344d1-fb40-4b05-8330-87f0f6622915 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:16.973115 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-857344d1-fb40-4b05-8330-87f0f6622915 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:16.973789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-857344d1-fb40-4b05-8330-87f0f6622915 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:17.141581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-857344d1-fb40-4b05-8330-87f0f6622915 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:17.150302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-857344d1-fb40-4b05-8330-87f0f6622915 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.196484 May 10 03:15:17.151132 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 82/175] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:16 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:18.169520 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b2335a0f-5ad5-498c-9bfd-7c5046b68c82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:18.170908 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b2335a0f-5ad5-498c-9bfd-7c5046b68c82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:18.177598 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b2335a0f-5ad5-498c-9bfd-7c5046b68c82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:18.178115 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b2335a0f-5ad5-498c-9bfd-7c5046b68c82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:18.179012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b2335a0f-5ad5-498c-9bfd-7c5046b68c82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:18.179511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b2335a0f-5ad5-498c-9bfd-7c5046b68c82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:18.335157 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b2335a0f-5ad5-498c-9bfd-7c5046b68c82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:18.343275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b2335a0f-5ad5-498c-9bfd-7c5046b68c82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.179446 May 10 03:15:18.355470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 94/176] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:18 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:19.361934 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-dd94c2d1-8135-4731-8a8b-0201155327d3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:19.362533 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-dd94c2d1-8135-4731-8a8b-0201155327d3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:19.368643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dd94c2d1-8135-4731-8a8b-0201155327d3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:19.369108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dd94c2d1-8135-4731-8a8b-0201155327d3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:19.369873 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dd94c2d1-8135-4731-8a8b-0201155327d3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:19.370361 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dd94c2d1-8135-4731-8a8b-0201155327d3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:19.505652 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-dd94c2d1-8135-4731-8a8b-0201155327d3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:19.513079 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-dd94c2d1-8135-4731-8a8b-0201155327d3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.155106 May 10 03:15:19.513642 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 83/177] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:19 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:20.529956 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e3acdd6e-bae3-4a98-84a1-6775e8f8f9b5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:20.530595 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e3acdd6e-bae3-4a98-84a1-6775e8f8f9b5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:20.537685 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e3acdd6e-bae3-4a98-84a1-6775e8f8f9b5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:20.538130 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e3acdd6e-bae3-4a98-84a1-6775e8f8f9b5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:20.538884 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e3acdd6e-bae3-4a98-84a1-6775e8f8f9b5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:20.539311 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e3acdd6e-bae3-4a98-84a1-6775e8f8f9b5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:20.668978 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e3acdd6e-bae3-4a98-84a1-6775e8f8f9b5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:20.676802 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e3acdd6e-bae3-4a98-84a1-6775e8f8f9b5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.150645 May 10 03:15:20.677375 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 95/178] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:20 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:21.695488 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b6c409af-dd43-4c38-9c90-eeeeee9b7f59 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:21.695992 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b6c409af-dd43-4c38-9c90-eeeeee9b7f59 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:21.703081 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b6c409af-dd43-4c38-9c90-eeeeee9b7f59 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:21.703543 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b6c409af-dd43-4c38-9c90-eeeeee9b7f59 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:21.704313 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b6c409af-dd43-4c38-9c90-eeeeee9b7f59 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:21.704963 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b6c409af-dd43-4c38-9c90-eeeeee9b7f59 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:21.854077 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b6c409af-dd43-4c38-9c90-eeeeee9b7f59 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:21.861506 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b6c409af-dd43-4c38-9c90-eeeeee9b7f59 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.171771 May 10 03:15:21.862166 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 84/179] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:21 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:22.880135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b69eb0ba-4e71-418e-aa7a-560eedd17376 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:22.880862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b69eb0ba-4e71-418e-aa7a-560eedd17376 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:22.886961 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b69eb0ba-4e71-418e-aa7a-560eedd17376 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:22.887411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b69eb0ba-4e71-418e-aa7a-560eedd17376 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:22.888181 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b69eb0ba-4e71-418e-aa7a-560eedd17376 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:22.888732 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b69eb0ba-4e71-418e-aa7a-560eedd17376 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:23.017635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b69eb0ba-4e71-418e-aa7a-560eedd17376 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:23.025242 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b69eb0ba-4e71-418e-aa7a-560eedd17376 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.149871 May 10 03:15:23.025814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 96/180] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:22 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:24.042174 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-63c525ba-af82-4c4c-b74c-dcd56d438d22 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:24.042782 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-63c525ba-af82-4c4c-b74c-dcd56d438d22 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:24.048775 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-63c525ba-af82-4c4c-b74c-dcd56d438d22 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:24.049223 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-63c525ba-af82-4c4c-b74c-dcd56d438d22 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:24.050681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-63c525ba-af82-4c4c-b74c-dcd56d438d22 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:24.051203 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-63c525ba-af82-4c4c-b74c-dcd56d438d22 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:24.177921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-63c525ba-af82-4c4c-b74c-dcd56d438d22 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:24.185239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-63c525ba-af82-4c4c-b74c-dcd56d438d22 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.146922 May 10 03:15:24.185803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 85/181] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:24 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:25.201289 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e7964041-d269-49e9-ab28-efeca2486dd6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:25.201906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e7964041-d269-49e9-ab28-efeca2486dd6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:25.208739 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e7964041-d269-49e9-ab28-efeca2486dd6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:25.209189 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e7964041-d269-49e9-ab28-efeca2486dd6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:25.210281 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e7964041-d269-49e9-ab28-efeca2486dd6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:25.210717 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e7964041-d269-49e9-ab28-efeca2486dd6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:25.341782 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e7964041-d269-49e9-ab28-efeca2486dd6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:25.350700 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e7964041-d269-49e9-ab28-efeca2486dd6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.153221 May 10 03:15:25.351265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 97/182] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:25 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:26.367367 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-440dceee-cff8-4d4b-a298-f59ed9f45f14 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:26.368130 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-440dceee-cff8-4d4b-a298-f59ed9f45f14 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:26.374234 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-440dceee-cff8-4d4b-a298-f59ed9f45f14 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:26.374674 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-440dceee-cff8-4d4b-a298-f59ed9f45f14 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:26.375438 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-440dceee-cff8-4d4b-a298-f59ed9f45f14 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:26.375869 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-440dceee-cff8-4d4b-a298-f59ed9f45f14 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:26.529844 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-440dceee-cff8-4d4b-a298-f59ed9f45f14 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:26.544599 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-440dceee-cff8-4d4b-a298-f59ed9f45f14 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.180918 May 10 03:15:26.546613 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 86/183] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:26 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:27.560409 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3b1b68c5-0684-4411-a25c-7b5bbd10bf06 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:27.561189 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3b1b68c5-0684-4411-a25c-7b5bbd10bf06 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:27.568550 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3b1b68c5-0684-4411-a25c-7b5bbd10bf06 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:27.569092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3b1b68c5-0684-4411-a25c-7b5bbd10bf06 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:27.569944 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3b1b68c5-0684-4411-a25c-7b5bbd10bf06 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:27.570447 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3b1b68c5-0684-4411-a25c-7b5bbd10bf06 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:27.705204 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3b1b68c5-0684-4411-a25c-7b5bbd10bf06 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:27.712565 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3b1b68c5-0684-4411-a25c-7b5bbd10bf06 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.156046 May 10 03:15:27.713174 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 98/184] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:27 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:28.730051 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7f7a0e52-ed92-4f99-b95e-b58f1d1eb167 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:28.730651 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7f7a0e52-ed92-4f99-b95e-b58f1d1eb167 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:28.736553 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7f7a0e52-ed92-4f99-b95e-b58f1d1eb167 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:28.737703 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7f7a0e52-ed92-4f99-b95e-b58f1d1eb167 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:28.738861 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7f7a0e52-ed92-4f99-b95e-b58f1d1eb167 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:28.739294 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7f7a0e52-ed92-4f99-b95e-b58f1d1eb167 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:28.868370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7f7a0e52-ed92-4f99-b95e-b58f1d1eb167 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:28.875902 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7f7a0e52-ed92-4f99-b95e-b58f1d1eb167 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.149696 May 10 03:15:28.876468 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 87/185] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:28 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:29.894323 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5ade2e29-6e07-4e6b-b27f-646d5d6f254f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:29.894935 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5ade2e29-6e07-4e6b-b27f-646d5d6f254f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:29.901350 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ade2e29-6e07-4e6b-b27f-646d5d6f254f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:29.901801 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ade2e29-6e07-4e6b-b27f-646d5d6f254f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:29.902595 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ade2e29-6e07-4e6b-b27f-646d5d6f254f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:29.903059 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ade2e29-6e07-4e6b-b27f-646d5d6f254f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:30.027529 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5ade2e29-6e07-4e6b-b27f-646d5d6f254f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:30.035682 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5ade2e29-6e07-4e6b-b27f-646d5d6f254f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.145942 May 10 03:15:30.036247 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 99/186] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:29 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:31.055107 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-07a46e7a-f068-4d5a-8aea-fbdde5b0b9d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:31.055955 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-07a46e7a-f068-4d5a-8aea-fbdde5b0b9d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:31.062344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-07a46e7a-f068-4d5a-8aea-fbdde5b0b9d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:31.062870 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-07a46e7a-f068-4d5a-8aea-fbdde5b0b9d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:31.064088 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-07a46e7a-f068-4d5a-8aea-fbdde5b0b9d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:31.064373 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-07a46e7a-f068-4d5a-8aea-fbdde5b0b9d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:31.243967 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-07a46e7a-f068-4d5a-8aea-fbdde5b0b9d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:31.251290 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-07a46e7a-f068-4d5a-8aea-fbdde5b0b9d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.202484 May 10 03:15:31.251855 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 88/187] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:31 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:32.285627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e7d6993b-da59-4770-a751-b23fe6b60b69 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:32.290657 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e7d6993b-da59-4770-a751-b23fe6b60b69 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:32.298482 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e7d6993b-da59-4770-a751-b23fe6b60b69 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:32.300208 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e7d6993b-da59-4770-a751-b23fe6b60b69 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:32.301221 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e7d6993b-da59-4770-a751-b23fe6b60b69 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:32.301771 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e7d6993b-da59-4770-a751-b23fe6b60b69 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:32.472311 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e7d6993b-da59-4770-a751-b23fe6b60b69 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:32.479986 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e7d6993b-da59-4770-a751-b23fe6b60b69 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.214603 May 10 03:15:32.480644 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 100/188] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:32 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:33.496783 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-89e89a21-4fcf-4a57-9154-fb3cc0e3e6a6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:33.497408 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-89e89a21-4fcf-4a57-9154-fb3cc0e3e6a6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:33.508103 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-89e89a21-4fcf-4a57-9154-fb3cc0e3e6a6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:33.508994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-89e89a21-4fcf-4a57-9154-fb3cc0e3e6a6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:33.510114 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-89e89a21-4fcf-4a57-9154-fb3cc0e3e6a6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:33.510839 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-89e89a21-4fcf-4a57-9154-fb3cc0e3e6a6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:33.664527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-89e89a21-4fcf-4a57-9154-fb3cc0e3e6a6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:33.671982 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-89e89a21-4fcf-4a57-9154-fb3cc0e3e6a6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.178962 May 10 03:15:33.672552 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 89/189] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:33 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:34.688700 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-03b3a938-1cb3-4438-9dd1-8759b0715a5c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:34.689310 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-03b3a938-1cb3-4438-9dd1-8759b0715a5c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:34.696695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-03b3a938-1cb3-4438-9dd1-8759b0715a5c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:34.697180 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-03b3a938-1cb3-4438-9dd1-8759b0715a5c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:34.698131 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-03b3a938-1cb3-4438-9dd1-8759b0715a5c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:34.698661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-03b3a938-1cb3-4438-9dd1-8759b0715a5c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:34.829928 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-03b3a938-1cb3-4438-9dd1-8759b0715a5c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:34.837798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-03b3a938-1cb3-4438-9dd1-8759b0715a5c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.152976 May 10 03:15:34.838367 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 101/190] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:34 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:35.855561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-33b889fa-7cfe-4e01-8634-73e17413df52 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:35.856270 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-33b889fa-7cfe-4e01-8634-73e17413df52 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:35.863793 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-33b889fa-7cfe-4e01-8634-73e17413df52 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:35.868801 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-33b889fa-7cfe-4e01-8634-73e17413df52 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:35.870319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-33b889fa-7cfe-4e01-8634-73e17413df52 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:35.870766 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-33b889fa-7cfe-4e01-8634-73e17413df52 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:36.038671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-33b889fa-7cfe-4e01-8634-73e17413df52 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:36.046733 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-33b889fa-7cfe-4e01-8634-73e17413df52 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.195145 May 10 03:15:36.056816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 90/191] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:35 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:37.063510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-70ec295e-7662-4634-89bd-5b05dba8a5bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:37.064129 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-70ec295e-7662-4634-89bd-5b05dba8a5bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:37.070391 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-70ec295e-7662-4634-89bd-5b05dba8a5bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:37.070841 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-70ec295e-7662-4634-89bd-5b05dba8a5bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:37.071638 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-70ec295e-7662-4634-89bd-5b05dba8a5bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:37.072073 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-70ec295e-7662-4634-89bd-5b05dba8a5bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:37.216473 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-70ec295e-7662-4634-89bd-5b05dba8a5bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:37.224955 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-70ec295e-7662-4634-89bd-5b05dba8a5bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.165115 May 10 03:15:37.225529 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 102/192] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:37 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:38.242643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ef9f063c-aa5e-4d7a-89d3-ba9b0cc45f82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:38.243842 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ef9f063c-aa5e-4d7a-89d3-ba9b0cc45f82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:38.250069 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ef9f063c-aa5e-4d7a-89d3-ba9b0cc45f82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:38.250516 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ef9f063c-aa5e-4d7a-89d3-ba9b0cc45f82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:38.251281 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ef9f063c-aa5e-4d7a-89d3-ba9b0cc45f82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:38.251852 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ef9f063c-aa5e-4d7a-89d3-ba9b0cc45f82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:38.391616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ef9f063c-aa5e-4d7a-89d3-ba9b0cc45f82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:38.399773 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ef9f063c-aa5e-4d7a-89d3-ba9b0cc45f82 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.161483 May 10 03:15:38.400358 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 91/193] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:38 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:39.417315 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-174dd47e-f272-46b2-a459-c30631ff7394 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:39.417931 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-174dd47e-f272-46b2-a459-c30631ff7394 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:39.424571 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-174dd47e-f272-46b2-a459-c30631ff7394 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:39.425385 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-174dd47e-f272-46b2-a459-c30631ff7394 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:39.426564 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-174dd47e-f272-46b2-a459-c30631ff7394 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:39.427005 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-174dd47e-f272-46b2-a459-c30631ff7394 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:39.563545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-174dd47e-f272-46b2-a459-c30631ff7394 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:39.572297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-174dd47e-f272-46b2-a459-c30631ff7394 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.158719 May 10 03:15:39.572829 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 103/194] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:39 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:40.589195 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-07de2cf3-036f-4fb5-b00d-24ecebbd2e09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:40.589802 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-07de2cf3-036f-4fb5-b00d-24ecebbd2e09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:40.596209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-07de2cf3-036f-4fb5-b00d-24ecebbd2e09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:40.596848 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-07de2cf3-036f-4fb5-b00d-24ecebbd2e09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:40.597641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-07de2cf3-036f-4fb5-b00d-24ecebbd2e09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:40.598075 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-07de2cf3-036f-4fb5-b00d-24ecebbd2e09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:40.728388 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-07de2cf3-036f-4fb5-b00d-24ecebbd2e09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:40.735738 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-07de2cf3-036f-4fb5-b00d-24ecebbd2e09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.150371 May 10 03:15:40.736303 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 92/195] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:40 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:41.753934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6128a530-135c-4060-9903-888e04e65049 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:41.754573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6128a530-135c-4060-9903-888e04e65049 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:41.761513 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6128a530-135c-4060-9903-888e04e65049 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:41.761955 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6128a530-135c-4060-9903-888e04e65049 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:41.762724 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6128a530-135c-4060-9903-888e04e65049 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:41.763155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6128a530-135c-4060-9903-888e04e65049 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:41.898908 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6128a530-135c-4060-9903-888e04e65049 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:41.906458 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6128a530-135c-4060-9903-888e04e65049 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.156407 May 10 03:15:41.907326 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 104/196] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:41 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:42.923629 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ba2784e0-5f22-4b90-bd03-3fad249f0711 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:42.924242 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ba2784e0-5f22-4b90-bd03-3fad249f0711 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:42.930980 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ba2784e0-5f22-4b90-bd03-3fad249f0711 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:42.931479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ba2784e0-5f22-4b90-bd03-3fad249f0711 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:42.932430 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ba2784e0-5f22-4b90-bd03-3fad249f0711 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:42.932899 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ba2784e0-5f22-4b90-bd03-3fad249f0711 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:43.066114 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ba2784e0-5f22-4b90-bd03-3fad249f0711 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:43.073862 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ba2784e0-5f22-4b90-bd03-3fad249f0711 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.154033 May 10 03:15:43.074443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 93/197] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:42 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:44.090148 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-87e619ed-b1b7-42a2-a088-8476c67e648e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:44.090764 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-87e619ed-b1b7-42a2-a088-8476c67e648e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:44.097257 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87e619ed-b1b7-42a2-a088-8476c67e648e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:44.097710 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87e619ed-b1b7-42a2-a088-8476c67e648e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:44.098480 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87e619ed-b1b7-42a2-a088-8476c67e648e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:44.098920 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87e619ed-b1b7-42a2-a088-8476c67e648e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:44.232342 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-87e619ed-b1b7-42a2-a088-8476c67e648e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:44.239702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-87e619ed-b1b7-42a2-a088-8476c67e648e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.153527 May 10 03:15:44.240273 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 105/198] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:44 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:45.256127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ee86d7ba-d9b9-4728-ae74-d882c31878f0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:45.256807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ee86d7ba-d9b9-4728-ae74-d882c31878f0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:45.262687 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ee86d7ba-d9b9-4728-ae74-d882c31878f0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:45.263128 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ee86d7ba-d9b9-4728-ae74-d882c31878f0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:45.263877 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ee86d7ba-d9b9-4728-ae74-d882c31878f0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:45.264306 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ee86d7ba-d9b9-4728-ae74-d882c31878f0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:45.392342 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ee86d7ba-d9b9-4728-ae74-d882c31878f0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:45.400458 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ee86d7ba-d9b9-4728-ae74-d882c31878f0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.147906 May 10 03:15:45.401163 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 94/199] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:45 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:46.417830 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-be3bb193-8df9-4e9d-999d-caf06d2d0edb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:46.418447 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-be3bb193-8df9-4e9d-999d-caf06d2d0edb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:46.424846 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-be3bb193-8df9-4e9d-999d-caf06d2d0edb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:46.425248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-be3bb193-8df9-4e9d-999d-caf06d2d0edb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:46.426010 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-be3bb193-8df9-4e9d-999d-caf06d2d0edb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:46.426551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-be3bb193-8df9-4e9d-999d-caf06d2d0edb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:46.561977 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-be3bb193-8df9-4e9d-999d-caf06d2d0edb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:46.570767 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-be3bb193-8df9-4e9d-999d-caf06d2d0edb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1521 microversion: 2.1 time: 0.156751 May 10 03:15:46.571342 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 106/200] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:46 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:47.587878 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-aae70a2c-fb06-4872-8ed2-0a6448071306 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:47.588484 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-aae70a2c-fb06-4872-8ed2-0a6448071306 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:47.594385 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aae70a2c-fb06-4872-8ed2-0a6448071306 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:47.594855 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aae70a2c-fb06-4872-8ed2-0a6448071306 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:47.595604 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aae70a2c-fb06-4872-8ed2-0a6448071306 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:47.596038 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aae70a2c-fb06-4872-8ed2-0a6448071306 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:47.729626 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-aae70a2c-fb06-4872-8ed2-0a6448071306 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:47.736953 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-aae70a2c-fb06-4872-8ed2-0a6448071306 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1501 microversion: 2.1 time: 0.153537 May 10 03:15:47.737512 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 95/201] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:47 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:47.754127 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0a040658-4216-4f56-81fa-9bd8cee5e15f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:47.754742 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0a040658-4216-4f56-81fa-9bd8cee5e15f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:47.761147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a040658-4216-4f56-81fa-9bd8cee5e15f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:47.761601 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a040658-4216-4f56-81fa-9bd8cee5e15f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:47.762361 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a040658-4216-4f56-81fa-9bd8cee5e15f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:47.762797 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a040658-4216-4f56-81fa-9bd8cee5e15f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:47.893422 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0a040658-4216-4f56-81fa-9bd8cee5e15f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:47.901701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0a040658-4216-4f56-81fa-9bd8cee5e15f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1515 microversion: 2.1 time: 0.151306 May 10 03:15:47.902279 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 107/202] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:47 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:49.268369 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c673a0e3-b1b1-48bc-92eb-bbfb7a108da7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:49.269400 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-c673a0e3-b1b1-48bc-92eb-bbfb7a108da7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:49.275309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c673a0e3-b1b1-48bc-92eb-bbfb7a108da7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:49.275756 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c673a0e3-b1b1-48bc-92eb-bbfb7a108da7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:49.276519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c673a0e3-b1b1-48bc-92eb-bbfb7a108da7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:49.276995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c673a0e3-b1b1-48bc-92eb-bbfb7a108da7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:49.299255 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-c673a0e3-b1b1-48bc-92eb-bbfb7a108da7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lazy-loading 'flavor' on Instance uuid a709d3d8-e66d-4642-aee4-392801ae2f15 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:15:49.420626 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c673a0e3-b1b1-48bc-92eb-bbfb7a108da7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15/action" status: 200 len: 32 microversion: 2.1 time: 0.156662 May 10 03:15:49.421246 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 96/203] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:15:49 2022] POST /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:15:49.430877 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3ec7bb00-bbde-4729-b2d6-e8a7b47ce9da tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:49.431633 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3ec7bb00-bbde-4729-b2d6-e8a7b47ce9da tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:49.438756 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3ec7bb00-bbde-4729-b2d6-e8a7b47ce9da tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:49.439623 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3ec7bb00-bbde-4729-b2d6-e8a7b47ce9da tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:49.440890 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3ec7bb00-bbde-4729-b2d6-e8a7b47ce9da tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:49.441596 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3ec7bb00-bbde-4729-b2d6-e8a7b47ce9da tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:49.665199 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3ec7bb00-bbde-4729-b2d6-e8a7b47ce9da tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:49.673165 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3ec7bb00-bbde-4729-b2d6-e8a7b47ce9da tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.246668 May 10 03:15:49.673887 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 108/204] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:49 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:15:50.691866 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ee99ecd4-6cdc-41fd-a69b-aa8c6631605f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:50.693126 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ee99ecd4-6cdc-41fd-a69b-aa8c6631605f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:50.699862 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ee99ecd4-6cdc-41fd-a69b-aa8c6631605f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:50.700701 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ee99ecd4-6cdc-41fd-a69b-aa8c6631605f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:50.701358 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ee99ecd4-6cdc-41fd-a69b-aa8c6631605f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:50.701791 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ee99ecd4-6cdc-41fd-a69b-aa8c6631605f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:50.835272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ee99ecd4-6cdc-41fd-a69b-aa8c6631605f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:50.843183 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ee99ecd4-6cdc-41fd-a69b-aa8c6631605f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.155752 May 10 03:15:50.843807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 97/205] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:50 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:15:51.860874 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e81867c6-5b53-4a87-a1b4-4f4ab7c7c532 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:51.861491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e81867c6-5b53-4a87-a1b4-4f4ab7c7c532 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:51.868665 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e81867c6-5b53-4a87-a1b4-4f4ab7c7c532 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:51.869103 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e81867c6-5b53-4a87-a1b4-4f4ab7c7c532 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:51.869884 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e81867c6-5b53-4a87-a1b4-4f4ab7c7c532 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:51.870341 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e81867c6-5b53-4a87-a1b4-4f4ab7c7c532 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:52.003346 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e81867c6-5b53-4a87-a1b4-4f4ab7c7c532 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:52.010539 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e81867c6-5b53-4a87-a1b4-4f4ab7c7c532 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.153586 May 10 03:15:52.011109 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 109/206] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:51 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:53.031147 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1597df60-e321-4813-9c39-721df0db5c8e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:53.031777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1597df60-e321-4813-9c39-721df0db5c8e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:53.046372 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1597df60-e321-4813-9c39-721df0db5c8e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:53.046817 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1597df60-e321-4813-9c39-721df0db5c8e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:53.047649 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1597df60-e321-4813-9c39-721df0db5c8e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:53.048073 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1597df60-e321-4813-9c39-721df0db5c8e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:53.176390 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1597df60-e321-4813-9c39-721df0db5c8e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:53.184419 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1597df60-e321-4813-9c39-721df0db5c8e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.157284 May 10 03:15:53.185015 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 98/207] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:53 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:54.201583 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dc403a42-1d92-4b45-96b6-64ab576bf78e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:54.202233 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-dc403a42-1d92-4b45-96b6-64ab576bf78e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:54.208720 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc403a42-1d92-4b45-96b6-64ab576bf78e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:54.209180 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc403a42-1d92-4b45-96b6-64ab576bf78e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:54.209960 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc403a42-1d92-4b45-96b6-64ab576bf78e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:54.210543 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc403a42-1d92-4b45-96b6-64ab576bf78e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:54.335960 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-dc403a42-1d92-4b45-96b6-64ab576bf78e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:54.343245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-dc403a42-1d92-4b45-96b6-64ab576bf78e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.145499 May 10 03:15:54.343822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 110/208] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:54 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:55.360731 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e8226e99-39f9-42e8-a2cf-3d189be9f6c4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:55.361346 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e8226e99-39f9-42e8-a2cf-3d189be9f6c4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:55.367930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e8226e99-39f9-42e8-a2cf-3d189be9f6c4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:55.368310 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e8226e99-39f9-42e8-a2cf-3d189be9f6c4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:55.369111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e8226e99-39f9-42e8-a2cf-3d189be9f6c4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:55.369545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e8226e99-39f9-42e8-a2cf-3d189be9f6c4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:55.496467 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e8226e99-39f9-42e8-a2cf-3d189be9f6c4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:55.503759 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e8226e99-39f9-42e8-a2cf-3d189be9f6c4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.146855 May 10 03:15:55.504323 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 99/209] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:55 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:55.674406 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-18e5dd7c-570f-4038-b1dd-8b9d402fa7a5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:55.674899 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-18e5dd7c-570f-4038-b1dd-8b9d402fa7a5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:55.681781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-18e5dd7c-570f-4038-b1dd-8b9d402fa7a5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:55.682231 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-18e5dd7c-570f-4038-b1dd-8b9d402fa7a5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:55.682987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-18e5dd7c-570f-4038-b1dd-8b9d402fa7a5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:55.683414 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-18e5dd7c-570f-4038-b1dd-8b9d402fa7a5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:55.705987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-18e5dd7c-570f-4038-b1dd-8b9d402fa7a5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/ips" status: 200 len: 151 microversion: 2.20 time: 0.035597 May 10 03:15:55.706544 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 111/210] 10.222.0.55 () {60 vars in 1288 bytes} [Tue May 10 03:15:55 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:15:56.521326 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-60948a51-7b74-42a5-a96c-fbea6694312a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:56.521951 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-60948a51-7b74-42a5-a96c-fbea6694312a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:56.527813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-60948a51-7b74-42a5-a96c-fbea6694312a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:56.528262 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-60948a51-7b74-42a5-a96c-fbea6694312a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:56.529064 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-60948a51-7b74-42a5-a96c-fbea6694312a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:56.529494 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-60948a51-7b74-42a5-a96c-fbea6694312a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:56.656376 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-60948a51-7b74-42a5-a96c-fbea6694312a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:56.663850 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-60948a51-7b74-42a5-a96c-fbea6694312a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.146513 May 10 03:15:56.664414 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 100/211] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:56 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:57.680767 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2632ffe3-5f17-4dc3-bf94-2aaf45f51ee7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:57.681299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2632ffe3-5f17-4dc3-bf94-2aaf45f51ee7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:57.687667 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2632ffe3-5f17-4dc3-bf94-2aaf45f51ee7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:57.688120 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2632ffe3-5f17-4dc3-bf94-2aaf45f51ee7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:57.688985 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2632ffe3-5f17-4dc3-bf94-2aaf45f51ee7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:57.689425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2632ffe3-5f17-4dc3-bf94-2aaf45f51ee7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:57.814506 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2632ffe3-5f17-4dc3-bf94-2aaf45f51ee7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:57.822343 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2632ffe3-5f17-4dc3-bf94-2aaf45f51ee7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.145681 May 10 03:15:57.822923 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 112/212] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:57 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:58.839352 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3bd0f0b5-bbe0-4a3e-96a3-d69acd0ca4b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:58.839893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3bd0f0b5-bbe0-4a3e-96a3-d69acd0ca4b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:58.845843 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0b5-bbe0-4a3e-96a3-d69acd0ca4b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:58.846293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0b5-bbe0-4a3e-96a3-d69acd0ca4b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:58.847056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0b5-bbe0-4a3e-96a3-d69acd0ca4b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:58.847489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3bd0f0b5-bbe0-4a3e-96a3-d69acd0ca4b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:58.973846 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3bd0f0b5-bbe0-4a3e-96a3-d69acd0ca4b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:58.981159 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3bd0f0b5-bbe0-4a3e-96a3-d69acd0ca4b9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.145887 May 10 03:15:58.981732 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 101/213] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:58 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:59.998073 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-86e48323-1e95-4b97-bb18-f3b759b57654 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:59.998680 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-86e48323-1e95-4b97-bb18-f3b759b57654 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:00.005023 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-86e48323-1e95-4b97-bb18-f3b759b57654 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:00.005472 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-86e48323-1e95-4b97-bb18-f3b759b57654 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:00.006261 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-86e48323-1e95-4b97-bb18-f3b759b57654 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:00.006691 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-86e48323-1e95-4b97-bb18-f3b759b57654 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:00.131502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-86e48323-1e95-4b97-bb18-f3b759b57654 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:00.139739 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-86e48323-1e95-4b97-bb18-f3b759b57654 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.145575 May 10 03:16:00.140309 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 113/214] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:15:59 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:01.157546 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4879b730-aa44-4b5b-a948-5c69ebccbbdd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:01.158158 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4879b730-aa44-4b5b-a948-5c69ebccbbdd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:01.164911 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4879b730-aa44-4b5b-a948-5c69ebccbbdd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:01.165359 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4879b730-aa44-4b5b-a948-5c69ebccbbdd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:01.166124 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4879b730-aa44-4b5b-a948-5c69ebccbbdd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:01.166556 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4879b730-aa44-4b5b-a948-5c69ebccbbdd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:01.290927 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4879b730-aa44-4b5b-a948-5c69ebccbbdd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:01.298100 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4879b730-aa44-4b5b-a948-5c69ebccbbdd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.144651 May 10 03:16:01.298670 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 102/215] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:01 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:01.324630 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2f1b7822-6b36-45ae-8369-f7bd96319795 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:01.325159 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2f1b7822-6b36-45ae-8369-f7bd96319795 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:01.331369 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f1b7822-6b36-45ae-8369-f7bd96319795 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:01.331817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f1b7822-6b36-45ae-8369-f7bd96319795 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:01.332579 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f1b7822-6b36-45ae-8369-f7bd96319795 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:01.333040 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f1b7822-6b36-45ae-8369-f7bd96319795 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:01.355157 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-2f1b7822-6b36-45ae-8369-f7bd96319795 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lazy-loading 'flavor' on Instance uuid 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:16:01.629998 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2f1b7822-6b36-45ae-8369-f7bd96319795 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/action" status: 202 len: 0 microversion: 2.20 time: 0.309080 May 10 03:16:01.632814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 114/216] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 10 03:16:01 2022] POST /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:16:01.640561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:01.641063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:01.649274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:01.649723 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:01.651198 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:01.652427 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:01.787245 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:01.795203 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:01.796726 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:01.797898 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-af2d905d-5263-4fe6-a614-9f98edca8494 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.161440 May 10 03:16:01.798468 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 103/217] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:01 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:02.315567 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c62988f8-296a-46cb-bd58-fcf08fe8222b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:02.316178 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c62988f8-296a-46cb-bd58-fcf08fe8222b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:02.322604 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c62988f8-296a-46cb-bd58-fcf08fe8222b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:02.323046 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c62988f8-296a-46cb-bd58-fcf08fe8222b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:02.323800 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c62988f8-296a-46cb-bd58-fcf08fe8222b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:02.324230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c62988f8-296a-46cb-bd58-fcf08fe8222b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:02.449728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c62988f8-296a-46cb-bd58-fcf08fe8222b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:02.457128 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c62988f8-296a-46cb-bd58-fcf08fe8222b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.145870 May 10 03:16:02.457730 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 115/218] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:02 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:02.819813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:02.820921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:02.826840 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:02.827290 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:02.828053 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:02.828483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:02.955821 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:02.963418 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:02.964937 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:02.966171 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-023517d3-7019-411f-9cce-57c64abb9da9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.150716 May 10 03:16:02.966724 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 104/219] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:02 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:03.475279 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d1c48082-85c8-4391-8acb-8de63a9eba45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:03.476483 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d1c48082-85c8-4391-8acb-8de63a9eba45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:03.482924 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d1c48082-85c8-4391-8acb-8de63a9eba45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:03.483375 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d1c48082-85c8-4391-8acb-8de63a9eba45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:03.484134 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d1c48082-85c8-4391-8acb-8de63a9eba45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:03.484568 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d1c48082-85c8-4391-8acb-8de63a9eba45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:03.610840 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d1c48082-85c8-4391-8acb-8de63a9eba45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:03.618289 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d1c48082-85c8-4391-8acb-8de63a9eba45 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.146906 May 10 03:16:03.618865 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 116/220] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:03 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:03.865525 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-19dd7877-c6b3-41df-9048-5140e4b3fbde tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:03.866044 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-19dd7877-c6b3-41df-9048-5140e4b3fbde tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:03.871852 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19dd7877-c6b3-41df-9048-5140e4b3fbde tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:03.872297 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19dd7877-c6b3-41df-9048-5140e4b3fbde tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:03.873085 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19dd7877-c6b3-41df-9048-5140e4b3fbde tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:03.873514 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19dd7877-c6b3-41df-9048-5140e4b3fbde tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:03.896381 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-19dd7877-c6b3-41df-9048-5140e4b3fbde tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/ips" status: 200 len: 147 microversion: 2.1 time: 0.034690 May 10 03:16:03.896989 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 105/221] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:16:03 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:03.984694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:03.985403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:03.991280 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:03.991902 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:03.992715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:03.993148 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:04.124683 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:04.136873 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:04.136873 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:04.137510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d339858c-5876-4a68-8970-c74ed9e4a0bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.156698 May 10 03:16:04.138325 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 117/222] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:03 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:04.465320 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fa8b271c-c8de-41c5-8ef7-865558b39c1a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:04.465820 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fa8b271c-c8de-41c5-8ef7-865558b39c1a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:04.471738 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fa8b271c-c8de-41c5-8ef7-865558b39c1a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:04.472204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fa8b271c-c8de-41c5-8ef7-865558b39c1a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:04.473023 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fa8b271c-c8de-41c5-8ef7-865558b39c1a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:04.473495 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fa8b271c-c8de-41c5-8ef7-865558b39c1a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:04.496647 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fa8b271c-c8de-41c5-8ef7-865558b39c1a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/ips" status: 200 len: 146 microversion: 2.1 time: 0.035167 May 10 03:16:04.497246 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 106/223] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:16:04 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:04.634967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8e3b1e95-f4aa-4822-81ed-4885f19c6600 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:04.635582 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8e3b1e95-f4aa-4822-81ed-4885f19c6600 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:04.641914 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e95-f4aa-4822-81ed-4885f19c6600 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:04.642369 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e95-f4aa-4822-81ed-4885f19c6600 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:04.643132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e95-f4aa-4822-81ed-4885f19c6600 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:04.643568 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e95-f4aa-4822-81ed-4885f19c6600 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:04.776919 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8e3b1e95-f4aa-4822-81ed-4885f19c6600 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:04.784499 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8e3b1e95-f4aa-4822-81ed-4885f19c6600 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.153465 May 10 03:16:04.785101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 118/224] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:04 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:05.156398 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:05.157372 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:05.163922 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:05.164383 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:05.165189 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:05.165625 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:05.246338 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b70910b8-bcdd-4f43-bd76-cdc1666ef430 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c323508-dd15-4528-9de7-827ec8686306"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:05.247449 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b70910b8-bcdd-4f43-bd76-cdc1666ef430 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:05.253360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b70910b8-bcdd-4f43-bd76-cdc1666ef430 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:05.253812 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b70910b8-bcdd-4f43-bd76-cdc1666ef430 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:05.254576 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b70910b8-bcdd-4f43-bd76-cdc1666ef430 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:05.255012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b70910b8-bcdd-4f43-bd76-cdc1666ef430 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:05.308448 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:05.316381 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:05.317997 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:05.319661 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-80884c48-6768-439f-8853-8d1b9b6a19b6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.166766 May 10 03:16:05.320216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 107/225] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:05 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:05.493011 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b70910b8-bcdd-4f43-bd76-cdc1666ef430 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250575 May 10 03:16:05.493621 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 119/226] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:16:05 2022] POST /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:05.801603 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d0849273-8c32-4ac7-a532-e8d5694be9f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:05.802217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d0849273-8c32-4ac7-a532-e8d5694be9f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:05.808790 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d0849273-8c32-4ac7-a532-e8d5694be9f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:05.809245 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d0849273-8c32-4ac7-a532-e8d5694be9f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:05.810009 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d0849273-8c32-4ac7-a532-e8d5694be9f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:05.810456 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d0849273-8c32-4ac7-a532-e8d5694be9f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:05.945469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d0849273-8c32-4ac7-a532-e8d5694be9f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:05.953800 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d0849273-8c32-4ac7-a532-e8d5694be9f6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.155973 May 10 03:16:05.954441 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 108/227] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:05 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:06.339423 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:06.340063 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:06.346460 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:06.346906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:06.347665 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:06.348095 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:06.486617 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:06.495095 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:06.496587 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:06.497769 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1ad6cbf1-2de3-44b7-8b6b-7f9bf9e7422f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.164109 May 10 03:16:06.498338 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 120/228] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:06 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:06.971341 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f672c411-f4cc-460c-b1fb-bf4cda90815b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:06.971945 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f672c411-f4cc-460c-b1fb-bf4cda90815b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:06.977849 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f672c411-f4cc-460c-b1fb-bf4cda90815b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:06.978301 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f672c411-f4cc-460c-b1fb-bf4cda90815b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:06.979065 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f672c411-f4cc-460c-b1fb-bf4cda90815b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:06.979494 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f672c411-f4cc-460c-b1fb-bf4cda90815b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:07.105969 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f672c411-f4cc-460c-b1fb-bf4cda90815b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:07.113325 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f672c411-f4cc-460c-b1fb-bf4cda90815b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.145850 May 10 03:16:07.113891 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 109/229] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:06 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:07.516027 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:07.516573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:07.523162 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:07.523609 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:07.524358 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:07.524813 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:07.655203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:07.663445 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:07.665587 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:07.666737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2e83b656-c4e2-4557-9f5c-7ea017c9fc5f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.154655 May 10 03:16:07.667305 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 121/230] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:07 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:08.130798 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0e9009a2-73cc-4cc6-8cee-1b00ef936590 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:08.131405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0e9009a2-73cc-4cc6-8cee-1b00ef936590 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:08.138910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e9009a2-73cc-4cc6-8cee-1b00ef936590 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:08.139310 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e9009a2-73cc-4cc6-8cee-1b00ef936590 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:08.140733 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e9009a2-73cc-4cc6-8cee-1b00ef936590 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:08.141347 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e9009a2-73cc-4cc6-8cee-1b00ef936590 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:08.267579 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0e9009a2-73cc-4cc6-8cee-1b00ef936590 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:08.275505 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0e9009a2-73cc-4cc6-8cee-1b00ef936590 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.148786 May 10 03:16:08.276091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 110/231] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:08 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:08.684575 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:08.685263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:08.691473 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:08.691927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:08.692716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:08.693151 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:08.817445 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:08.825683 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:08.827190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:08.828346 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e2217455-5a01-4e67-bb85-3b0cb15363f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.147583 May 10 03:16:08.828949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 122/232] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:08 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:09.291792 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cdce4df8-1c09-4845-b82f-acd017629a9e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:09.292401 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-cdce4df8-1c09-4845-b82f-acd017629a9e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:09.298283 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cdce4df8-1c09-4845-b82f-acd017629a9e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:09.298735 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cdce4df8-1c09-4845-b82f-acd017629a9e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:09.299497 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cdce4df8-1c09-4845-b82f-acd017629a9e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:09.299931 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cdce4df8-1c09-4845-b82f-acd017629a9e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:09.570204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-cdce4df8-1c09-4845-b82f-acd017629a9e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:09.577386 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-cdce4df8-1c09-4845-b82f-acd017629a9e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.289392 May 10 03:16:09.577956 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 111/233] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:09 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:09.846960 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:09.847499 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:09.854095 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:09.854651 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:09.855428 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:09.855864 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:09.980786 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:09.988392 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:09.989929 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:09.991070 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-00a54b35-17db-425b-815f-56bf9c48adb7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.148071 May 10 03:16:09.992134 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 123/234] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:09 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:10.595519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8786446b-89a0-49cf-91ef-ca0338380b29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:10.596316 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8786446b-89a0-49cf-91ef-ca0338380b29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:10.603832 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8786446b-89a0-49cf-91ef-ca0338380b29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:10.604284 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8786446b-89a0-49cf-91ef-ca0338380b29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:10.605086 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8786446b-89a0-49cf-91ef-ca0338380b29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:10.605524 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8786446b-89a0-49cf-91ef-ca0338380b29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:10.747024 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8786446b-89a0-49cf-91ef-ca0338380b29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:10.754388 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8786446b-89a0-49cf-91ef-ca0338380b29 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.163960 May 10 03:16:10.754950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 112/235] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:10 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:11.010231 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:11.010844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:11.017309 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:11.017669 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:11.018475 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:11.018872 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:11.155101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:11.163168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:11.165007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:11.166165 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f9651d84-05e7-4bd9-9987-bc806776ad30 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.160528 May 10 03:16:11.166741 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 124/236] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:11 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:11.308372 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-6e3ab36d-5737-4e48-8075-dac9e53eee32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ab91f5c-b50b-4270-a578-d3071e593cd6"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:11.309460 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-6e3ab36d-5737-4e48-8075-dac9e53eee32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:11.315295 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6e3ab36d-5737-4e48-8075-dac9e53eee32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:11.315744 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6e3ab36d-5737-4e48-8075-dac9e53eee32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:11.316504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6e3ab36d-5737-4e48-8075-dac9e53eee32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:11.316964 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6e3ab36d-5737-4e48-8075-dac9e53eee32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:11.586053 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-6e3ab36d-5737-4e48-8075-dac9e53eee32 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281397 May 10 03:16:11.586776 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 113/237] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:16:11 2022] POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:11.772070 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4c8dc458-689e-4994-9b0d-7237a747cdc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:11.773371 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4c8dc458-689e-4994-9b0d-7237a747cdc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:11.779373 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4c8dc458-689e-4994-9b0d-7237a747cdc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:11.780042 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4c8dc458-689e-4994-9b0d-7237a747cdc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:11.780943 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4c8dc458-689e-4994-9b0d-7237a747cdc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:11.781958 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4c8dc458-689e-4994-9b0d-7237a747cdc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:11.935719 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4c8dc458-689e-4994-9b0d-7237a747cdc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:11.946969 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4c8dc458-689e-4994-9b0d-7237a747cdc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1501 microversion: 2.1 time: 0.175941 May 10 03:16:11.946969 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 125/238] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:11 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:11.962351 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7eb9f351-938a-48d0-ac74-2e013711f6a9"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:11.963770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:11.970893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:11.971338 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:11.972204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:11.972642 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:11.998962 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] HTTP exception thrown: Cannot 'attach_volume' instance a709d3d8-e66d-4642-aee4-392801ae2f15 while it is in vm_state rescued May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Request method failure captured: May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: POST /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15/os-volume_attachments HTTP/1.1 May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 74 May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediXoO1wImN1nMxT7K0VFnyk-ud7eOJBfMgvkNRRRr-cf-c1mcytsGc40j8U9iPKKpvhj7s4rxCFBuOPM9_AXH95peSeHP4-tgZcvutqW8yWliNsFkMABsaym8GaQSqonSfuSW4PejjvkQwy4uAy_wNtzWSflyQWwONBu9NEa0mM9bE May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: d2279255bed8483c82ba27a2451313fc May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:16:12.000950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d2279255bed8483c82ba27a2451313fc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d2279255bed8483c82ba27a2451313fc"}]}] May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: d2279255bed8483c82ba27a2451313fc May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 6dac5d7569d4402ca9c910ea8862b5d9 May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {"volumeAttachment": {"volumeId": "7eb9f351-938a-48d0-ac74-2e013711f6a9"}} May 10 03:16:12.002522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Cannot 'attach_volume' instance a709d3d8-e66d-4642-aee4-392801ae2f15 while it is in vm_state rescued May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'server_id': 'a709d3d8-e66d-4642-aee4-392801ae2f15', 'body': {'volumeAttachment': {'volumeId': '7eb9f351-938a-48d0-ac74-2e013711f6a9'}}} May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a709d3d8-e66d-4642-aee4-392801ae2f15 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:16:12.006946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a709d3d8-e66d-4642-aee4-392801ae2f15 while it is in vm_state rescued May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:16:12.008091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:16:12.009278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:16:12.009278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:16:12.009278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a709d3d8-e66d-4642-aee4-392801ae2f15 while it is in vm_state rescued May 10 03:16:12.009278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:16:12.009278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Returning 409 to user: Cannot 'attach_volume' instance a709d3d8-e66d-4642-aee4-392801ae2f15 while it is in vm_state rescued {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:16:12.009278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-bd8768cd-a443-4581-9b09-1701377eef4e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045601 May 10 03:16:12.009278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 114/239] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:16:11 2022] POST /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 03:16:12.012672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-541ec88d-202c-4015-afe0-395da6d38136 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:12.013255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-541ec88d-202c-4015-afe0-395da6d38136 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:12.020555 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-541ec88d-202c-4015-afe0-395da6d38136 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:12.021203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-541ec88d-202c-4015-afe0-395da6d38136 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:12.022005 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-541ec88d-202c-4015-afe0-395da6d38136 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:12.022437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-541ec88d-202c-4015-afe0-395da6d38136 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:12.105064 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-541ec88d-202c-4015-afe0-395da6d38136 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15/action" status: 202 len: 0 microversion: 2.1 time: 0.096280 May 10 03:16:12.109291 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 126/240] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:16:12 2022] POST /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:16:12.115408 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1e02b72f-770d-4c87-9697-bbb7680ce85e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:12.116028 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1e02b72f-770d-4c87-9697-bbb7680ce85e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:12.123251 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1e02b72f-770d-4c87-9697-bbb7680ce85e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:12.123708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1e02b72f-770d-4c87-9697-bbb7680ce85e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:12.124481 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1e02b72f-770d-4c87-9697-bbb7680ce85e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:12.125185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1e02b72f-770d-4c87-9697-bbb7680ce85e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:12.186141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:12.187039 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:12.193368 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:12.194161 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:12.195311 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:12.195755 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:12.270882 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1e02b72f-770d-4c87-9697-bbb7680ce85e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:12.280489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1e02b72f-770d-4c87-9697-bbb7680ce85e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1509 microversion: 2.1 time: 0.170020 May 10 03:16:12.281125 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 115/241] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:12 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:12.414931 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:12.425712 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:12.427309 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:12.429230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c4aa9040-a30a-415d-8c8a-ddf056bfbec1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.247474 May 10 03:16:12.430579 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 127/242] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:12 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:13.014425 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-933a6f5c-4a8c-49e4-9708-84ef152ba315 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: .version_select at 0x7f14a6ba2e50>, body: {"keypair": {"name": "tempest-keypair-1571105423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGv3tNnnf0HhqVGaireT+Jsr5ufwTgpSHk3qMDYwbULM02JKARrtICV9qXMS4eYlb5CMWQm0YoxPMAfxRyF0LatQizdMDoFaEr0yBh9b66XRvhIMmg3OyRtP6Z5rfKaJOw=="}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:13.039971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-933a6f5c-4a8c-49e4-9708-84ef152ba315 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:16:13.044565 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-933a6f5c-4a8c-49e4-9708-84ef152ba315 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for user 775d3d61ab8d42c3a528028592ad71f8 and project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:16:13.089467 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-933a6f5c-4a8c-49e4-9708-84ef152ba315 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079073 May 10 03:16:13.090306 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 116/243] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:16:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:13.300054 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c0c512fa-3d69-4c38-aac3-33d39844f4cb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:13.301091 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c0c512fa-3d69-4c38-aac3-33d39844f4cb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:13.313417 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c0c512fa-3d69-4c38-aac3-33d39844f4cb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:13.314100 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c0c512fa-3d69-4c38-aac3-33d39844f4cb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:13.315042 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c0c512fa-3d69-4c38-aac3-33d39844f4cb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:13.315634 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c0c512fa-3d69-4c38-aac3-33d39844f4cb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:13.450371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:13.450983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:13.457927 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:13.459157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:13.461100 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:13.462163 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:13.626320 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:13.636943 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:13.638796 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:13.640235 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2705674d-9d4e-4181-81fb-3ad8caaa9d8e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.194479 May 10 03:16:13.640830 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 117/244] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:13 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:13.917754 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c0c512fa-3d69-4c38-aac3-33d39844f4cb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:13.937526 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c0c512fa-3d69-4c38-aac3-33d39844f4cb tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1509 microversion: 2.1 time: 0.631688 May 10 03:16:13.939656 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 128/245] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:13 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1509 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:14.659224 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:14.659845 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:14.673075 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:14.673784 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:14.674585 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:14.675184 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:14.902930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:14.920668 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:14.922504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:14.927663 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0157b29b-e123-4f2c-b169-820fdb9dae4c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.272717 May 10 03:16:14.940958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 118/246] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:14 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:14.957545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-80033d03-295e-42b0-a5f2-97798ad6497a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:14.958223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-80033d03-295e-42b0-a5f2-97798ad6497a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:14.966054 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-80033d03-295e-42b0-a5f2-97798ad6497a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:14.966499 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-80033d03-295e-42b0-a5f2-97798ad6497a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:14.967532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-80033d03-295e-42b0-a5f2-97798ad6497a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:14.967967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-80033d03-295e-42b0-a5f2-97798ad6497a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:15.228543 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-80033d03-295e-42b0-a5f2-97798ad6497a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:15.240150 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-80033d03-295e-42b0-a5f2-97798ad6497a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1509 microversion: 2.1 time: 0.286945 May 10 03:16:15.253686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 129/247] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:14 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:15.295688 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-463364032", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20b0c49b-98e0-4d73-bdea-8b46faafc116"}], "security_groups": [{"name": "tempest-securitygroup--2034764655"}], "key_name": "tempest-keypair-1571105423", "user_data": "}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:15.442165 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] validate_networks() for [('20b0c49b-98e0-4d73-bdea-8b46faafc116', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:16:15.928246 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:16:15.929792 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:16:15.930833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:16:15.931683 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:16:15.933437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:16:15.948634 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:15.949928 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:15.958720 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:15.959272 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:15.968403 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:15.968915 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:15.970149 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:15.970672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:15.973943 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:15.974411 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:16.009208 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:16:16.027452 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for user 775d3d61ab8d42c3a528028592ad71f8 and project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:16:16.042546 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:16:16.055005 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:16:16.143350 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-beb5f0ae-1a6b-466e-b58d-0f9cc7d948f9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.852337 May 10 03:16:16.144713 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 119/248] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:16:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:16:16.174104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f34d0835-8b89-44c4-9f4b-e7bb22986796 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:16.176024 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f34d0835-8b89-44c4-9f4b-e7bb22986796 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:16.257982 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f34d0835-8b89-44c4-9f4b-e7bb22986796 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:16.270902 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f34d0835-8b89-44c4-9f4b-e7bb22986796 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1241 microversion: 2.1 time: 0.105619 May 10 03:16:16.278576 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:16.286150 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 120/249] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:16 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:16.293011 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9d3c05a7-4730-4974-9652-b8f193ef4760 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:16.293803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9d3c05a7-4730-4974-9652-b8f193ef4760 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:16.295666 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:16.297337 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:16.298537 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4d31cc23-261d-44df-a8ea-da9f55db45ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.355094 May 10 03:16:16.299126 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 130/250] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:15 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:16.301026 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9d3c05a7-4730-4974-9652-b8f193ef4760 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:16.301684 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9d3c05a7-4730-4974-9652-b8f193ef4760 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:16.302611 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9d3c05a7-4730-4974-9652-b8f193ef4760 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:16.303203 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9d3c05a7-4730-4974-9652-b8f193ef4760 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:16.483983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9d3c05a7-4730-4974-9652-b8f193ef4760 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:16.491728 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9d3c05a7-4730-4974-9652-b8f193ef4760 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1515 microversion: 2.1 time: 0.204280 May 10 03:16:16.492935 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 121/251] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:16 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:17.294066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-64eab258-a80c-4c5a-bca4-3864b5358c88 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:17.295278 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-64eab258-a80c-4c5a-bca4-3864b5358c88 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:17.301853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64eab258-a80c-4c5a-bca4-3864b5358c88 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:17.302305 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64eab258-a80c-4c5a-bca4-3864b5358c88 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:17.303081 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64eab258-a80c-4c5a-bca4-3864b5358c88 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:17.303517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64eab258-a80c-4c5a-bca4-3864b5358c88 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:17.316826 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:17.317558 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:17.324191 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:17.324639 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:17.325420 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:17.325881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:17.366212 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-64eab258-a80c-4c5a-bca4-3864b5358c88 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:17.373790 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-64eab258-a80c-4c5a-bca4-3864b5358c88 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1293 microversion: 2.1 time: 0.084069 May 10 03:16:17.374367 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 131/252] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:17 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:17.457114 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:17.470098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:17.471981 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:17.473395 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-bd529b76-42b4-4522-bc03-6fe0748b76a0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1745 microversion: 2.20 time: 0.160434 May 10 03:16:17.473951 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 122/253] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:17 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:16:17.949690 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8dcd29e6-6424-4905-bc10-c6ff88ac1551 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'create', calling method: .version_select at 0x7f1497fad310>, body: {"keypair": {"name": "tempest-keypair-1692384457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv9f2OBUYLxrynR++fAoOXEqc0HmyoBu2XgMJGfQDWyKQX2I6MMkNfjTSCfNSzGILwP06PBfTMFHCtxT4FC7OUDSCxKqWY9DUrB57sJXS5qEANCJWEpfFnmaMvn6e4NkQ=="}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:17.964933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-8dcd29e6-6424-4905-bc10-c6ff88ac1551 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Getting quotas for project d2279255bed8483c82ba27a2451313fc. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:16:17.970197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-8dcd29e6-6424-4905-bc10-c6ff88ac1551 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Getting quotas for user 6dac5d7569d4402ca9c910ea8862b5d9 and project d2279255bed8483c82ba27a2451313fc. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:16:18.006549 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8dcd29e6-6424-4905-bc10-c6ff88ac1551 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062833 May 10 03:16:18.008246 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 132/254] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:16:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:18.008855 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1732679684", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "networks": [{"uuid": "1de77f49-b9d8-4f50-8c23-0e4791428a47"}]}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:18.079111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] validate_networks() for [('1de77f49-b9d8-4f50-8c23-0e4791428a47', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:16:18.391846 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dc5e78b1-3526-4b7d-a019-2cde7ca06727 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:18.393574 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-dc5e78b1-3526-4b7d-a019-2cde7ca06727 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:18.405260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc5e78b1-3526-4b7d-a019-2cde7ca06727 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:18.408712 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc5e78b1-3526-4b7d-a019-2cde7ca06727 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:18.409764 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc5e78b1-3526-4b7d-a019-2cde7ca06727 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:18.410998 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc5e78b1-3526-4b7d-a019-2cde7ca06727 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:18.797767 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-dc5e78b1-3526-4b7d-a019-2cde7ca06727 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:18.809532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-dc5e78b1-3526-4b7d-a019-2cde7ca06727 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.421561 May 10 03:16:18.811149 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 133/255] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:18 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:18.824174 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:18.825296 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:18.832748 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:18.833828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:18.836066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:18.836762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:18.909837 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:16:18.910857 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:16:18.911423 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:16:18.912019 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:16:18.912529 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:16:18.923511 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:18.924101 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:18.925071 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:18.925624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:18.944841 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Getting quotas for project 7c623f8bafbe4349a313eef2b75c8154. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:16:18.949095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Getting quotas for user 1f176581b3794d139a4546d6aef2b959 and project 7c623f8bafbe4349a313eef2b75c8154. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:16:18.961344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:16:18.963665 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:16:19.027698 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f1f0a88d-ddd7-49a8-a9ee-687e81768a38 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023811 May 10 03:16:19.029214 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 123/256] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:16:19.041726 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7dc3801a-c456-45d6-8c19-639303bc3454 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:19.043219 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:19.049860 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7dc3801a-c456-45d6-8c19-639303bc3454 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:19.070885 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:19.079333 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:19.080860 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9c3d2e37-445a-48ba-a17f-b1be598cb45c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1745 microversion: 2.20 time: 0.268087 May 10 03:16:19.091627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 134/257] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:18 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1745 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:19.145915 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7dc3801a-c456-45d6-8c19-639303bc3454 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:19.159127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7dc3801a-c456-45d6-8c19-639303bc3454 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1219 microversion: 2.1 time: 0.123038 May 10 03:16:19.166527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 124/258] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:19 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:19.424692 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-b03ae829-e5b1-4d2e-a369-3f60d760c848 req-f7065806-546c-499b-b459-6212d6d71307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e38f9a8-3e80-482e-8726-0ce7f4da09cf", "tag": "bbc5b7a0-9d80-4868-9a66-432452cedc93"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:19.440498 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-b03ae829-e5b1-4d2e-a369-3f60d760c848 req-f7065806-546c-499b-b459-6212d6d71307 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:19.446188 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-b03ae829-e5b1-4d2e-a369-3f60d760c848 req-f7065806-546c-499b-b459-6212d6d71307 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:19.459604 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-b03ae829-e5b1-4d2e-a369-3f60d760c848 req-f7065806-546c-499b-b459-6212d6d71307 service nova] Creating event network-changed:bbc5b7a0-9d80-4868-9a66-432452cedc93 for instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf on hv-cinder-83009 May 10 03:16:19.466329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-b03ae829-e5b1-4d2e-a369-3f60d760c848 req-f7065806-546c-499b-b459-6212d6d71307 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046513 May 10 03:16:19.467391 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 135/259] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:19.828395 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-69d9dddb-4ee8-4dd4-9036-d8bde1955635 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:19.828953 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-69d9dddb-4ee8-4dd4-9036-d8bde1955635 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:19.835755 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-69d9dddb-4ee8-4dd4-9036-d8bde1955635 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:19.836199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-69d9dddb-4ee8-4dd4-9036-d8bde1955635 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:19.837002 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-69d9dddb-4ee8-4dd4-9036-d8bde1955635 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:19.837435 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-69d9dddb-4ee8-4dd4-9036-d8bde1955635 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:20.027220 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-69d9dddb-4ee8-4dd4-9036-d8bde1955635 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:20.034857 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-69d9dddb-4ee8-4dd4-9036-d8bde1955635 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.210468 May 10 03:16:20.036698 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 125/260] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:19 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:20.102424 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:20.103123 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:20.106916 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1300924728", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73cc213e-781c-42c1-8c05-7293b0a3f3ad"}], "security_groups": [{"name": "tempest-securitygroup--2101180076"}], "key_name": "tempest-keypair-1692384457", "user_data": "}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:20.110898 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:20.111356 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:20.112411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:20.112559 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:20.217495 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] validate_networks() for [('73cc213e-781c-42c1-8c05-7293b0a3f3ad', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:16:20.245908 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:20.254076 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:20.255563 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:20.257342 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-87a3625d-a3bf-4322-b9fc-6c20548f5929 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1745 microversion: 2.20 time: 0.159106 May 10 03:16:20.258160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 136/261] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:20 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:20.262542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-56f90e2b-58e1-4c0a-a9e5-6454f983dff7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:20.263138 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-56f90e2b-58e1-4c0a-a9e5-6454f983dff7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:20.269971 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-56f90e2b-58e1-4c0a-a9e5-6454f983dff7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:20.270429 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-56f90e2b-58e1-4c0a-a9e5-6454f983dff7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:20.271209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-56f90e2b-58e1-4c0a-a9e5-6454f983dff7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:20.271653 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-56f90e2b-58e1-4c0a-a9e5-6454f983dff7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:20.332603 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-56f90e2b-58e1-4c0a-a9e5-6454f983dff7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:20.340791 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-56f90e2b-58e1-4c0a-a9e5-6454f983dff7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1223 microversion: 2.1 time: 0.081625 May 10 03:16:20.341374 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 137/262] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:20 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:20.580468 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:16:20.580926 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:16:20.581431 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:16:20.581835 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:16:20.582245 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:16:20.590890 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:20.591344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:20.592185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:20.592624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:20.608640 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Getting quotas for project d2279255bed8483c82ba27a2451313fc. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:16:20.612353 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Getting quotas for user 6dac5d7569d4402ca9c910ea8862b5d9 and project d2279255bed8483c82ba27a2451313fc. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:16:20.623851 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:16:20.625974 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:16:20.672201 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4b785894-4441-4640-96f8-883f52471733 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.569500 May 10 03:16:20.677848 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 126/263] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:16:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:16:20.683284 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-05d57b19-1fd7-4e5c-8d40-58b0069340c0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:20.684039 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-05d57b19-1fd7-4e5c-8d40-58b0069340c0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:20.746265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-05d57b19-1fd7-4e5c-8d40-58b0069340c0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:20.753174 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-05d57b19-1fd7-4e5c-8d40-58b0069340c0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1246 microversion: 2.1 time: 0.074279 May 10 03:16:20.753775 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 138/264] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:20 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:21.052723 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f025f73e-93fc-4e82-af9c-af7f9e1126d2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:21.053340 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f025f73e-93fc-4e82-af9c-af7f9e1126d2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:21.060606 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f025f73e-93fc-4e82-af9c-af7f9e1126d2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.061083 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f025f73e-93fc-4e82-af9c-af7f9e1126d2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:21.061846 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f025f73e-93fc-4e82-af9c-af7f9e1126d2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.062279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f025f73e-93fc-4e82-af9c-af7f9e1126d2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:21.189836 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f025f73e-93fc-4e82-af9c-af7f9e1126d2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:21.197371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f025f73e-93fc-4e82-af9c-af7f9e1126d2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.148962 May 10 03:16:21.197947 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 127/265] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:21 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:21.275817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:21.276419 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:21.282629 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.283068 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:21.283821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.284252 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:21.357978 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-925b25db-2b4b-4bf8-b3eb-d11600fc6de4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:21.358586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-925b25db-2b4b-4bf8-b3eb-d11600fc6de4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:21.364464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-925b25db-2b4b-4bf8-b3eb-d11600fc6de4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.364944 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-925b25db-2b4b-4bf8-b3eb-d11600fc6de4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:21.365707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-925b25db-2b4b-4bf8-b3eb-d11600fc6de4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.366143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-925b25db-2b4b-4bf8-b3eb-d11600fc6de4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:21.412966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:21.421673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:21.423203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:21.424404 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f8b1625d-ffb9-4b73-bc94-545ef3ad24d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1745 microversion: 2.20 time: 0.153084 May 10 03:16:21.424994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-925b25db-2b4b-4bf8-b3eb-d11600fc6de4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:21.425136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 139/266] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:21 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:21.432642 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-925b25db-2b4b-4bf8-b3eb-d11600fc6de4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1223 microversion: 2.1 time: 0.078598 May 10 03:16:21.433271 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 128/267] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:21 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:21.770495 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-64bbd607-5b11-4706-a600-b5114a2966c5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:21.771105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-64bbd607-5b11-4706-a600-b5114a2966c5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:21.778198 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64bbd607-5b11-4706-a600-b5114a2966c5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.778649 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64bbd607-5b11-4706-a600-b5114a2966c5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:21.779410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64bbd607-5b11-4706-a600-b5114a2966c5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.779843 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64bbd607-5b11-4706-a600-b5114a2966c5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:21.855331 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-64bbd607-5b11-4706-a600-b5114a2966c5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:21.864613 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-64bbd607-5b11-4706-a600-b5114a2966c5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1250 microversion: 2.1 time: 0.097748 May 10 03:16:21.865604 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 140/268] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:21 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:22.051866 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-d9fc3508-67d8-4bbb-896e-c7e26d657f3d req-0e370147-2011-47b7-82fc-2ab675e56c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f", "name": "network-vif-plugged", "status": "completed", "tag": "3ec8beef-b88c-43f8-8d89-f6c589198e59"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:22.070763 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-d9fc3508-67d8-4bbb-896e-c7e26d657f3d req-0e370147-2011-47b7-82fc-2ab675e56c72 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.072244 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-d9fc3508-67d8-4bbb-896e-c7e26d657f3d req-0e370147-2011-47b7-82fc-2ab675e56c72 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.089566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-d9fc3508-67d8-4bbb-896e-c7e26d657f3d req-0e370147-2011-47b7-82fc-2ab675e56c72 service nova] Creating event network-vif-plugged:3ec8beef-b88c-43f8-8d89-f6c589198e59 for instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f on hv-cinder-83009 May 10 03:16:22.095885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-d9fc3508-67d8-4bbb-896e-c7e26d657f3d req-0e370147-2011-47b7-82fc-2ab675e56c72 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049136 May 10 03:16:22.096955 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 129/269] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:22.214210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c4287784-14e5-49a8-81ea-46508f0e4c2e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:22.214917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c4287784-14e5-49a8-81ea-46508f0e4c2e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:22.242109 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c4287784-14e5-49a8-81ea-46508f0e4c2e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.242559 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c4287784-14e5-49a8-81ea-46508f0e4c2e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.243338 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c4287784-14e5-49a8-81ea-46508f0e4c2e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.243771 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c4287784-14e5-49a8-81ea-46508f0e4c2e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.335758 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b2532eca-f3f5-4f20-99f2-b7e5b58cb531 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:22.342333 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b2532eca-f3f5-4f20-99f2-b7e5b58cb531 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.342905 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b2532eca-f3f5-4f20-99f2-b7e5b58cb531 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.403190 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b2532eca-f3f5-4f20-99f2-b7e5b58cb531 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Going to try to stop instance {{(pid=117119) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 03:16:22.431573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c4287784-14e5-49a8-81ea-46508f0e4c2e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:22.443798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c4287784-14e5-49a8-81ea-46508f0e4c2e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.231736 May 10 03:16:22.451220 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 141/270] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:22 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:22.456373 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:22.457009 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:22.465400 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b2532eca-f3f5-4f20-99f2-b7e5b58cb531 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/action" status: 202 len: 0 microversion: 2.1 time: 0.134220 May 10 03:16:22.470041 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.470127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 130/271] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:16:22 2022] POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:16:22.470199 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.470199 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.470199 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.471571 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c7a585c4-7bd3-467a-8225-ccf9c8ca698d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:22.472726 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-c7a585c4-7bd3-467a-8225-ccf9c8ca698d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:22.480718 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7a585c4-7bd3-467a-8225-ccf9c8ca698d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.481169 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7a585c4-7bd3-467a-8225-ccf9c8ca698d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.482149 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7a585c4-7bd3-467a-8225-ccf9c8ca698d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.482738 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7a585c4-7bd3-467a-8225-ccf9c8ca698d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.554676 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-c7a585c4-7bd3-467a-8225-ccf9c8ca698d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:22.562572 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c7a585c4-7bd3-467a-8225-ccf9c8ca698d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1271 microversion: 2.1 time: 0.095028 May 10 03:16:22.563179 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 131/272] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:22 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:22.567589 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9b33abfc-c4bb-4ba7-9c2c-312bb494921b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:22.568196 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9b33abfc-c4bb-4ba7-9c2c-312bb494921b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:22.575043 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9b33abfc-c4bb-4ba7-9c2c-312bb494921b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.575479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9b33abfc-c4bb-4ba7-9c2c-312bb494921b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.576247 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9b33abfc-c4bb-4ba7-9c2c-312bb494921b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.576730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9b33abfc-c4bb-4ba7-9c2c-312bb494921b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.608181 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:22.616203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:22.617743 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:22.618913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-84c34ec0-ccf3-443f-bcf7-9520eedd2121 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.166725 May 10 03:16:22.619476 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 142/273] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:22 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:22.706097 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9b33abfc-c4bb-4ba7-9c2c-312bb494921b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:22.724743 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9b33abfc-c4bb-4ba7-9c2c-312bb494921b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.156366 May 10 03:16:22.728438 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 132/274] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:22 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:22.882831 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ebe6675f-0d94-44ed-afa3-a67a1fc448e1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:22.884181 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ebe6675f-0d94-44ed-afa3-a67a1fc448e1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:22.891579 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ebe6675f-0d94-44ed-afa3-a67a1fc448e1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.892257 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ebe6675f-0d94-44ed-afa3-a67a1fc448e1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.893586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ebe6675f-0d94-44ed-afa3-a67a1fc448e1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.894289 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ebe6675f-0d94-44ed-afa3-a67a1fc448e1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.234754 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ebe6675f-0d94-44ed-afa3-a67a1fc448e1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:23.244859 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ebe6675f-0d94-44ed-afa3-a67a1fc448e1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1306 microversion: 2.1 time: 0.366983 May 10 03:16:23.245442 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 143/275] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:22 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1306 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:23.463422 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-254ee3e3-814b-42f4-8cdd-98babff4761a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:23.463956 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-254ee3e3-814b-42f4-8cdd-98babff4761a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:23.471711 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-254ee3e3-814b-42f4-8cdd-98babff4761a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.472183 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-254ee3e3-814b-42f4-8cdd-98babff4761a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.473403 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-254ee3e3-814b-42f4-8cdd-98babff4761a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.473843 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-254ee3e3-814b-42f4-8cdd-98babff4761a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.580597 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-23c9c2a2-5cb8-4a4a-8379-5ef43be7d504 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:23.581359 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-23c9c2a2-5cb8-4a4a-8379-5ef43be7d504 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:23.594061 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-23c9c2a2-5cb8-4a4a-8379-5ef43be7d504 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.599364 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-23c9c2a2-5cb8-4a4a-8379-5ef43be7d504 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.601072 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-23c9c2a2-5cb8-4a4a-8379-5ef43be7d504 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.603081 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-23c9c2a2-5cb8-4a4a-8379-5ef43be7d504 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.687677 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-254ee3e3-814b-42f4-8cdd-98babff4761a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:23.698718 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-254ee3e3-814b-42f4-8cdd-98babff4761a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.239691 May 10 03:16:23.700103 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 133/276] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:23 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:23.705152 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:23.705959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:23.713601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.714128 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.716211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.716912 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.851506 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-23c9c2a2-5cb8-4a4a-8379-5ef43be7d504 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:23.860980 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-23c9c2a2-5cb8-4a4a-8379-5ef43be7d504 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1277 microversion: 2.1 time: 0.284274 May 10 03:16:23.862284 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 144/277] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:23 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:23.875537 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-68d34e58-a789-4112-8056-6e8a5e29182b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:23.876531 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-68d34e58-a789-4112-8056-6e8a5e29182b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:23.888579 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-68d34e58-a789-4112-8056-6e8a5e29182b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.889484 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-68d34e58-a789-4112-8056-6e8a5e29182b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.893900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-68d34e58-a789-4112-8056-6e8a5e29182b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.894465 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-68d34e58-a789-4112-8056-6e8a5e29182b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.906637 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:23.917980 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:23.919668 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:23.921036 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7394c003-8de4-4565-8b49-6070c6986868 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.219412 May 10 03:16:23.931912 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 134/278] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:23 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:24.230227 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-68d34e58-a789-4112-8056-6e8a5e29182b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:24.244749 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-68d34e58-a789-4112-8056-6e8a5e29182b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.380767 May 10 03:16:24.245355 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 145/279] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:23 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:24.264415 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0743a7c9-b978-4f7f-a83d-03c0874c748e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:24.265060 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0743a7c9-b978-4f7f-a83d-03c0874c748e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:24.283464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0743a7c9-b978-4f7f-a83d-03c0874c748e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:24.284181 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0743a7c9-b978-4f7f-a83d-03c0874c748e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:24.285269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0743a7c9-b978-4f7f-a83d-03c0874c748e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:24.285867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0743a7c9-b978-4f7f-a83d-03c0874c748e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:24.389366 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0743a7c9-b978-4f7f-a83d-03c0874c748e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:24.397330 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0743a7c9-b978-4f7f-a83d-03c0874c748e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1304 microversion: 2.1 time: 0.136657 May 10 03:16:24.407373 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 135/280] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:24 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:24.721065 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d3411938-c0ab-43d2-9d03-f55b6ebd5242 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:24.722705 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d3411938-c0ab-43d2-9d03-f55b6ebd5242 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:24.732429 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d3411938-c0ab-43d2-9d03-f55b6ebd5242 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:24.735897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d3411938-c0ab-43d2-9d03-f55b6ebd5242 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:24.737542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d3411938-c0ab-43d2-9d03-f55b6ebd5242 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:24.738211 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d3411938-c0ab-43d2-9d03-f55b6ebd5242 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:24.892938 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-89e36aee-afe7-4841-a876-b3c50d668aee tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:24.893807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-89e36aee-afe7-4841-a876-b3c50d668aee tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:24.902606 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-89e36aee-afe7-4841-a876-b3c50d668aee tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:24.903328 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-89e36aee-afe7-4841-a876-b3c50d668aee tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:24.904473 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-89e36aee-afe7-4841-a876-b3c50d668aee tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:24.905108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-89e36aee-afe7-4841-a876-b3c50d668aee tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:25.014825 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d3411938-c0ab-43d2-9d03-f55b6ebd5242 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:25.024970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d3411938-c0ab-43d2-9d03-f55b6ebd5242 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.312712 May 10 03:16:25.035100 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 146/281] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:24 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:25.041828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:25.042635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:25.055578 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:25.056256 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:25.065378 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:25.066022 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:25.115024 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-89e36aee-afe7-4841-a876-b3c50d668aee tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:25.133723 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-89e36aee-afe7-4841-a876-b3c50d668aee tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1319 microversion: 2.1 time: 0.246572 May 10 03:16:25.139262 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 136/282] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:24 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:25.262992 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-417c842c-710c-4b84-826a-44d0982eb2d8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:25.263744 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-417c842c-710c-4b84-826a-44d0982eb2d8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:25.272214 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-417c842c-710c-4b84-826a-44d0982eb2d8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:25.277410 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-417c842c-710c-4b84-826a-44d0982eb2d8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:25.278245 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-417c842c-710c-4b84-826a-44d0982eb2d8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:25.278689 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-417c842c-710c-4b84-826a-44d0982eb2d8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:25.410260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:25.433572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:25.435102 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:25.436288 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b41d3694-38f9-410f-a4ad-1095549361d4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.399726 May 10 03:16:25.437198 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 147/283] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:25 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:25.447092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8e8f4464-993a-4540-9f1f-8318895e3937 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:25.447956 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8e8f4464-993a-4540-9f1f-8318895e3937 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:25.458253 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8e8f4464-993a-4540-9f1f-8318895e3937 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:25.458928 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8e8f4464-993a-4540-9f1f-8318895e3937 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:25.461291 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8e8f4464-993a-4540-9f1f-8318895e3937 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:25.463442 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8e8f4464-993a-4540-9f1f-8318895e3937 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:25.523424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-417c842c-710c-4b84-826a-44d0982eb2d8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:25.532867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-417c842c-710c-4b84-826a-44d0982eb2d8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.273556 May 10 03:16:25.540770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 137/284] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:25 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:25.848442 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8e8f4464-993a-4540-9f1f-8318895e3937 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:25.864964 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8e8f4464-993a-4540-9f1f-8318895e3937 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.426498 May 10 03:16:25.865610 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 148/285] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:25 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:26.043775 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7a5c2041-8e4e-41e8-a00c-df22732de365 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:26.044586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7a5c2041-8e4e-41e8-a00c-df22732de365 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:26.056630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a5c2041-8e4e-41e8-a00c-df22732de365 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.057553 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a5c2041-8e4e-41e8-a00c-df22732de365 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:26.058594 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a5c2041-8e4e-41e8-a00c-df22732de365 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.063320 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a5c2041-8e4e-41e8-a00c-df22732de365 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:26.157766 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1fcc2d41-74c7-4667-a42a-7cee3393d301 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:26.158541 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1fcc2d41-74c7-4667-a42a-7cee3393d301 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:26.172083 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1fcc2d41-74c7-4667-a42a-7cee3393d301 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.173900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1fcc2d41-74c7-4667-a42a-7cee3393d301 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:26.175756 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1fcc2d41-74c7-4667-a42a-7cee3393d301 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.176971 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1fcc2d41-74c7-4667-a42a-7cee3393d301 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:26.346132 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7a5c2041-8e4e-41e8-a00c-df22732de365 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:26.356524 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7a5c2041-8e4e-41e8-a00c-df22732de365 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.317435 May 10 03:16:26.357479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 138/286] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:26 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:26.457086 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:26.458766 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:26.494151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.495593 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:26.496825 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.506488 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:26.578627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1fcc2d41-74c7-4667-a42a-7cee3393d301 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:26.600197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1fcc2d41-74c7-4667-a42a-7cee3393d301 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1319 microversion: 2.1 time: 0.441640 May 10 03:16:26.602494 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 149/287] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:26 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:26.610119 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c167a5f0-f60e-4bf2-97b4-cdeabc603965 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:26.629669 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c167a5f0-f60e-4bf2-97b4-cdeabc603965 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:26.644538 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c167a5f0-f60e-4bf2-97b4-cdeabc603965 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.645357 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c167a5f0-f60e-4bf2-97b4-cdeabc603965 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:26.646384 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c167a5f0-f60e-4bf2-97b4-cdeabc603965 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.647899 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c167a5f0-f60e-4bf2-97b4-cdeabc603965 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:26.896325 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:26.911094 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:26.919371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:26.920978 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ea7d7eb9-cb1b-42f7-8c6f-bdcb009c84df tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.469197 May 10 03:16:26.923956 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 139/288] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:26 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:26.929068 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a633de1e-e6d2-42f9-883c-935a735bc63b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:26.941849 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a633de1e-e6d2-42f9-883c-935a735bc63b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:26.949215 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a633de1e-e6d2-42f9-883c-935a735bc63b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.951317 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a633de1e-e6d2-42f9-883c-935a735bc63b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:26.961447 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a633de1e-e6d2-42f9-883c-935a735bc63b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:26.962122 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a633de1e-e6d2-42f9-883c-935a735bc63b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:27.177134 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a633de1e-e6d2-42f9-883c-935a735bc63b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:27.188962 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a633de1e-e6d2-42f9-883c-935a735bc63b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.263428 May 10 03:16:27.189711 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 140/289] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:26 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:27.203263 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-7e13374c-5d7a-438d-b47f-593d4c8ade1e req-1fa09851-d4e3-4748-b270-d03f1c12180c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a714b2-630e-4616-9da3-f0acae26fb24", "tag": "d0ecc293-10f4-407f-97ea-01ab5c2dbe91"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:27.209205 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c167a5f0-f60e-4bf2-97b4-cdeabc603965 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:27.214816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-7e13374c-5d7a-438d-b47f-593d4c8ade1e req-1fa09851-d4e3-4748-b270-d03f1c12180c service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:27.214816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-7e13374c-5d7a-438d-b47f-593d4c8ade1e req-1fa09851-d4e3-4748-b270-d03f1c12180c service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:27.225931 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-7e13374c-5d7a-438d-b47f-593d4c8ade1e req-1fa09851-d4e3-4748-b270-d03f1c12180c service nova] Creating event network-changed:d0ecc293-10f4-407f-97ea-01ab5c2dbe91 for instance c1a714b2-630e-4616-9da3-f0acae26fb24 on hv-cinder-83009 May 10 03:16:27.231496 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-7e13374c-5d7a-438d-b47f-593d4c8ade1e req-1fa09851-d4e3-4748-b270-d03f1c12180c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040373 May 10 03:16:27.232104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 141/290] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:27.232469 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c167a5f0-f60e-4bf2-97b4-cdeabc603965 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.628549 May 10 03:16:27.233093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 150/291] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:26 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:27.375315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0672af14-0eb0-4c9b-be33-8eeb2e42b199 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:27.376280 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0672af14-0eb0-4c9b-be33-8eeb2e42b199 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:27.383762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0672af14-0eb0-4c9b-be33-8eeb2e42b199 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:27.384472 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0672af14-0eb0-4c9b-be33-8eeb2e42b199 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:27.385440 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0672af14-0eb0-4c9b-be33-8eeb2e42b199 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:27.386168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0672af14-0eb0-4c9b-be33-8eeb2e42b199 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:27.584133 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0672af14-0eb0-4c9b-be33-8eeb2e42b199 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:27.594519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0672af14-0eb0-4c9b-be33-8eeb2e42b199 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.224077 May 10 03:16:27.604581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 142/292] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:27 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:27.618324 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-697d1a15-923f-4787-8116-4b4f111ce774 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:27.619281 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-697d1a15-923f-4787-8116-4b4f111ce774 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:27.628547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-697d1a15-923f-4787-8116-4b4f111ce774 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:27.629002 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-697d1a15-923f-4787-8116-4b4f111ce774 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:27.629796 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-697d1a15-923f-4787-8116-4b4f111ce774 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:27.630238 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-697d1a15-923f-4787-8116-4b4f111ce774 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:27.951144 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:27.952905 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:27.968359 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:27.968848 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:27.969630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:27.970062 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:28.070657 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-697d1a15-923f-4787-8116-4b4f111ce774 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:28.079206 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-697d1a15-923f-4787-8116-4b4f111ce774 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1319 microversion: 2.1 time: 0.464995 May 10 03:16:28.086041 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 151/293] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:27 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:28.168107 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-274d87bf-3a72-4e54-9038-0f86c62c8fe1 req-22611e84-1b4f-462c-af75-3ec28778a06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e38f9a8-3e80-482e-8726-0ce7f4da09cf", "name": "network-vif-plugged", "status": "completed", "tag": "bbc5b7a0-9d80-4868-9a66-432452cedc93"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:28.173227 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:28.184470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-274d87bf-3a72-4e54-9038-0f86c62c8fe1 req-22611e84-1b4f-462c-af75-3ec28778a06d service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:28.185713 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-274d87bf-3a72-4e54-9038-0f86c62c8fe1 req-22611e84-1b4f-462c-af75-3ec28778a06d service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:28.186306 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:28.188747 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:28.190239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5cd7a893-7bd8-4aa1-b3af-17e176fa4d87 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.243222 May 10 03:16:28.202408 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 143/294] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:27 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:28.207815 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d935bab3-3991-438d-8094-e701a5e1e5f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:28.208705 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d935bab3-3991-438d-8094-e701a5e1e5f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:28.210900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-274d87bf-3a72-4e54-9038-0f86c62c8fe1 req-22611e84-1b4f-462c-af75-3ec28778a06d service nova] Creating event network-vif-plugged:bbc5b7a0-9d80-4868-9a66-432452cedc93 for instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf on hv-cinder-83009 May 10 03:16:28.215837 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d935bab3-3991-438d-8094-e701a5e1e5f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:28.216537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d935bab3-3991-438d-8094-e701a5e1e5f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:28.217614 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d935bab3-3991-438d-8094-e701a5e1e5f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:28.218244 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d935bab3-3991-438d-8094-e701a5e1e5f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:28.231505 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-274d87bf-3a72-4e54-9038-0f86c62c8fe1 req-22611e84-1b4f-462c-af75-3ec28778a06d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066827 May 10 03:16:28.232527 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 152/295] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:28.254146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0e9edf03-06c1-4aa7-85d8-f748fd1ce58e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:28.256038 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0e9edf03-06c1-4aa7-85d8-f748fd1ce58e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:28.276703 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0e9edf03-06c1-4aa7-85d8-f748fd1ce58e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:28.294062 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0e9edf03-06c1-4aa7-85d8-f748fd1ce58e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:28.309193 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0e9edf03-06c1-4aa7-85d8-f748fd1ce58e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:28.309852 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0e9edf03-06c1-4aa7-85d8-f748fd1ce58e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:28.448803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d935bab3-3991-438d-8094-e701a5e1e5f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:28.458633 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d935bab3-3991-438d-8094-e701a5e1e5f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.254768 May 10 03:16:28.468737 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 144/296] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:28 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:28.612291 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-68b91feb-0a9e-4f70-aeff-7df30f6a0f8b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:28.613215 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-68b91feb-0a9e-4f70-aeff-7df30f6a0f8b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:28.626074 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-68b91feb-0a9e-4f70-aeff-7df30f6a0f8b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:28.626802 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-68b91feb-0a9e-4f70-aeff-7df30f6a0f8b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:28.627979 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-68b91feb-0a9e-4f70-aeff-7df30f6a0f8b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:28.628573 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-68b91feb-0a9e-4f70-aeff-7df30f6a0f8b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:28.654556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0e9edf03-06c1-4aa7-85d8-f748fd1ce58e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:28.666796 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0e9edf03-06c1-4aa7-85d8-f748fd1ce58e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.416388 May 10 03:16:28.667551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 153/297] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:28 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:28.792563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-68b91feb-0a9e-4f70-aeff-7df30f6a0f8b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:28.800569 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-68b91feb-0a9e-4f70-aeff-7df30f6a0f8b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.193013 May 10 03:16:28.801183 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 145/298] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:28 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:29.102226 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2ed2ec95-9023-4070-a34a-a90797b6bcf8 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:29.102949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2ed2ec95-9023-4070-a34a-a90797b6bcf8 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:29.109546 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2ed2ec95-9023-4070-a34a-a90797b6bcf8 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.110067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2ed2ec95-9023-4070-a34a-a90797b6bcf8 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.110901 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2ed2ec95-9023-4070-a34a-a90797b6bcf8 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.111504 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2ed2ec95-9023-4070-a34a-a90797b6bcf8 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.210788 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:29.211398 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:29.226135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.226600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.227397 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.227836 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.284532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2ed2ec95-9023-4070-a34a-a90797b6bcf8 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:29.293619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2ed2ec95-9023-4070-a34a-a90797b6bcf8 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1319 microversion: 2.1 time: 0.195392 May 10 03:16:29.304401 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 154/299] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:29 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:29.309630 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-445e2ba3-e2d5-4af6-b0b5-87708a00a660 req-4163e6cc-9eca-48f8-98f5-c41eca4e2929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b10b34-f1d6-49fe-982c-8d00255bc565", "tag": "7b55a664-e823-4d00-8935-550519d0fdf6"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:29.319581 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-445e2ba3-e2d5-4af6-b0b5-87708a00a660 req-4163e6cc-9eca-48f8-98f5-c41eca4e2929 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.320266 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-445e2ba3-e2d5-4af6-b0b5-87708a00a660 req-4163e6cc-9eca-48f8-98f5-c41eca4e2929 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.332134 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-445e2ba3-e2d5-4af6-b0b5-87708a00a660 req-4163e6cc-9eca-48f8-98f5-c41eca4e2929 service nova] Creating event network-changed:7b55a664-e823-4d00-8935-550519d0fdf6 for instance 80b10b34-f1d6-49fe-982c-8d00255bc565 on hv-cinder-83009 May 10 03:16:29.338973 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-445e2ba3-e2d5-4af6-b0b5-87708a00a660 req-4163e6cc-9eca-48f8-98f5-c41eca4e2929 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032832 May 10 03:16:29.340234 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 155/300] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:29.394839 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:29.404640 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:29.406175 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:29.407644 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d044daa5-c442-4caf-afbb-0af8dd49fa82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.201590 May 10 03:16:29.408685 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 146/301] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:29 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:16:29.477058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1bb232c0-4d95-4a22-83c6-8a99c012d85a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:29.478037 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1bb232c0-4d95-4a22-83c6-8a99c012d85a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:29.484866 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1bb232c0-4d95-4a22-83c6-8a99c012d85a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.485317 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1bb232c0-4d95-4a22-83c6-8a99c012d85a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.486157 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1bb232c0-4d95-4a22-83c6-8a99c012d85a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.486594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1bb232c0-4d95-4a22-83c6-8a99c012d85a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.637699 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1bb232c0-4d95-4a22-83c6-8a99c012d85a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:29.646206 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1bb232c0-4d95-4a22-83c6-8a99c012d85a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.173343 May 10 03:16:29.647504 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 156/302] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:29 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:29.683571 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2538730c-9d5d-40e4-8214-db4d4fbea40d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:29.684172 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2538730c-9d5d-40e4-8214-db4d4fbea40d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:29.691926 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2538730c-9d5d-40e4-8214-db4d4fbea40d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.692763 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2538730c-9d5d-40e4-8214-db4d4fbea40d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.693624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2538730c-9d5d-40e4-8214-db4d4fbea40d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.696828 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2538730c-9d5d-40e4-8214-db4d4fbea40d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.817670 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5354d543-0f27-4ca7-9d08-35fa3312b8e6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:29.818684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5354d543-0f27-4ca7-9d08-35fa3312b8e6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:29.830024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5354d543-0f27-4ca7-9d08-35fa3312b8e6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.830979 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5354d543-0f27-4ca7-9d08-35fa3312b8e6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.831858 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5354d543-0f27-4ca7-9d08-35fa3312b8e6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:29.832398 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5354d543-0f27-4ca7-9d08-35fa3312b8e6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:29.864323 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2538730c-9d5d-40e4-8214-db4d4fbea40d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:29.877498 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2538730c-9d5d-40e4-8214-db4d4fbea40d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.197695 May 10 03:16:29.888292 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 147/303] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:29 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:29.994792 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5354d543-0f27-4ca7-9d08-35fa3312b8e6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:30.002892 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5354d543-0f27-4ca7-9d08-35fa3312b8e6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.189054 May 10 03:16:30.013537 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 157/304] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:29 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:30.310681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7a89dfa9-47a4-467c-b70c-d08a528870f4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:30.311287 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7a89dfa9-47a4-467c-b70c-d08a528870f4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:30.317744 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a89dfa9-47a4-467c-b70c-d08a528870f4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:30.318196 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a89dfa9-47a4-467c-b70c-d08a528870f4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:30.318991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a89dfa9-47a4-467c-b70c-d08a528870f4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:30.319413 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a89dfa9-47a4-467c-b70c-d08a528870f4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:30.425730 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:30.426419 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:30.433331 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:30.433796 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:30.435096 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:30.435096 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:30.475862 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7a89dfa9-47a4-467c-b70c-d08a528870f4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:30.489717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7a89dfa9-47a4-467c-b70c-d08a528870f4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1319 microversion: 2.1 time: 0.182774 May 10 03:16:30.499588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 148/305] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:30 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:30.596699 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:30.604934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:30.606570 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:30.607888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-90347e82-5329-4467-9d78-d3dd67ecbcb2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.186025 May 10 03:16:30.608555 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 158/306] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:30 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:16:30.666159 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-97435fc7-8f92-4a24-80a2-07714108d58d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:30.667278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-97435fc7-8f92-4a24-80a2-07714108d58d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:30.673191 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-97435fc7-8f92-4a24-80a2-07714108d58d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:30.673641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-97435fc7-8f92-4a24-80a2-07714108d58d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:30.674421 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-97435fc7-8f92-4a24-80a2-07714108d58d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:30.674867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-97435fc7-8f92-4a24-80a2-07714108d58d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:30.830783 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-97435fc7-8f92-4a24-80a2-07714108d58d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:30.840691 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-97435fc7-8f92-4a24-80a2-07714108d58d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.178837 May 10 03:16:30.841550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 149/307] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:30 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:30.895160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7a011fdc-7f72-4a97-b359-fd2ed6cdeaca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:30.895962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7a011fdc-7f72-4a97-b359-fd2ed6cdeaca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:30.908541 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7a011fdc-7f72-4a97-b359-fd2ed6cdeaca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:30.909213 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7a011fdc-7f72-4a97-b359-fd2ed6cdeaca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:30.910018 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7a011fdc-7f72-4a97-b359-fd2ed6cdeaca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:30.910475 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7a011fdc-7f72-4a97-b359-fd2ed6cdeaca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:31.021203 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3376568b-d8cc-4e92-b408-742bca671e96 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:31.021623 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3376568b-d8cc-4e92-b408-742bca671e96 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:31.035356 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3376568b-d8cc-4e92-b408-742bca671e96 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:31.035806 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3376568b-d8cc-4e92-b408-742bca671e96 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:31.036582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3376568b-d8cc-4e92-b408-742bca671e96 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:31.037044 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3376568b-d8cc-4e92-b408-742bca671e96 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:31.111616 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-7a011fdc-7f72-4a97-b359-fd2ed6cdeaca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:31.126854 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7a011fdc-7f72-4a97-b359-fd2ed6cdeaca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.235438 May 10 03:16:31.140758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 159/308] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:30 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:31.201356 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3376568b-d8cc-4e92-b408-742bca671e96 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:31.213177 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3376568b-d8cc-4e92-b408-742bca671e96 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.196084 May 10 03:16:31.216699 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 150/309] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:31 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:31.509338 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8292f430-b598-4ca8-9482-1d73e160a8bc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:31.509944 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8292f430-b598-4ca8-9482-1d73e160a8bc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:31.517719 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8292f430-b598-4ca8-9482-1d73e160a8bc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:31.518298 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8292f430-b598-4ca8-9482-1d73e160a8bc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:31.521340 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8292f430-b598-4ca8-9482-1d73e160a8bc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:31.521340 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8292f430-b598-4ca8-9482-1d73e160a8bc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:31.630764 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:31.631954 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:31.643619 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:31.644077 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:31.644910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:31.645797 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:31.810138 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8292f430-b598-4ca8-9482-1d73e160a8bc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:31.818399 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8292f430-b598-4ca8-9482-1d73e160a8bc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1319 microversion: 2.1 time: 0.314091 May 10 03:16:31.826752 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 160/310] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:31 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:31.859100 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4da537d7-b2da-4559-a9b2-f2165cbb9745 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:31.859776 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4da537d7-b2da-4559-a9b2-f2165cbb9745 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:31.871689 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4da537d7-b2da-4559-a9b2-f2165cbb9745 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:31.871689 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4da537d7-b2da-4559-a9b2-f2165cbb9745 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:31.871689 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4da537d7-b2da-4559-a9b2-f2165cbb9745 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:31.871689 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4da537d7-b2da-4559-a9b2-f2165cbb9745 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:31.894561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:31.906259 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:31.913486 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:31.916209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1d521e22-52cb-424d-8b4b-c4419cfa528c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.289779 May 10 03:16:31.916842 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 151/311] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:31 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:32.101767 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4da537d7-b2da-4559-a9b2-f2165cbb9745 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:32.111013 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4da537d7-b2da-4559-a9b2-f2165cbb9745 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.255925 May 10 03:16:32.111871 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 161/312] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:31 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:32.133027 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-064d1aaa-455a-42fe-ac84-6833943927fb req-6736f3a5-b752-43c3-a50a-600e662fc314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a714b2-630e-4616-9da3-f0acae26fb24", "name": "network-vif-plugged", "status": "completed", "tag": "d0ecc293-10f4-407f-97ea-01ab5c2dbe91"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:32.146508 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-64c78ffe-3af6-45fb-a8a8-750e7fd1e564 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:32.147155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-64c78ffe-3af6-45fb-a8a8-750e7fd1e564 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:32.151287 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-064d1aaa-455a-42fe-ac84-6833943927fb req-6736f3a5-b752-43c3-a50a-600e662fc314 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.151732 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-064d1aaa-455a-42fe-ac84-6833943927fb req-6736f3a5-b752-43c3-a50a-600e662fc314 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.159588 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64c78ffe-3af6-45fb-a8a8-750e7fd1e564 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.159901 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64c78ffe-3af6-45fb-a8a8-750e7fd1e564 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.160721 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64c78ffe-3af6-45fb-a8a8-750e7fd1e564 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.161155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-64c78ffe-3af6-45fb-a8a8-750e7fd1e564 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.173522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-064d1aaa-455a-42fe-ac84-6833943927fb req-6736f3a5-b752-43c3-a50a-600e662fc314 service nova] Creating event network-vif-plugged:d0ecc293-10f4-407f-97ea-01ab5c2dbe91 for instance c1a714b2-630e-4616-9da3-f0acae26fb24 on hv-cinder-83009 May 10 03:16:32.181526 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-064d1aaa-455a-42fe-ac84-6833943927fb req-6736f3a5-b752-43c3-a50a-600e662fc314 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052649 May 10 03:16:32.183722 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 152/313] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:32.237749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bce1e9ea-4731-4153-812c-11aae64ccd0c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:32.238985 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-bce1e9ea-4731-4153-812c-11aae64ccd0c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:32.250375 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bce1e9ea-4731-4153-812c-11aae64ccd0c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.252578 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bce1e9ea-4731-4153-812c-11aae64ccd0c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.255593 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bce1e9ea-4731-4153-812c-11aae64ccd0c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.256213 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bce1e9ea-4731-4153-812c-11aae64ccd0c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.324783 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-64c78ffe-3af6-45fb-a8a8-750e7fd1e564 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:32.339545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-64c78ffe-3af6-45fb-a8a8-750e7fd1e564 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.197044 May 10 03:16:32.350951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 162/314] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:32 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:32.431934 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-bce1e9ea-4731-4153-812c-11aae64ccd0c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:32.439717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-bce1e9ea-4731-4153-812c-11aae64ccd0c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1367 microversion: 2.1 time: 0.211335 May 10 03:16:32.442854 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 153/315] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:32 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:32.837088 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e320b98b-43b4-4d82-9c55-7393ac16ba2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:32.839521 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e320b98b-43b4-4d82-9c55-7393ac16ba2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:32.853686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e320b98b-43b4-4d82-9c55-7393ac16ba2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.854384 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e320b98b-43b4-4d82-9c55-7393ac16ba2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.856195 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e320b98b-43b4-4d82-9c55-7393ac16ba2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.856834 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e320b98b-43b4-4d82-9c55-7393ac16ba2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.941791 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:32.942994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:32.953624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.954073 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.954872 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.955420 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:33.060057 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e320b98b-43b4-4d82-9c55-7393ac16ba2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:33.071596 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e320b98b-43b4-4d82-9c55-7393ac16ba2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1319 microversion: 2.1 time: 0.239973 May 10 03:16:33.075737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 163/316] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:32 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:33.111142 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:33.119612 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:33.121146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:33.123613 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a56ca206-4a62-4898-9d92-06462ca332b9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.184492 May 10 03:16:33.134333 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-286ef977-d8dd-4cc0-98eb-c8ea6ca572aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:33.134535 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 154/317] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:32 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:16:33.135407 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-286ef977-d8dd-4cc0-98eb-c8ea6ca572aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:33.146757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-286ef977-d8dd-4cc0-98eb-c8ea6ca572aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:33.148307 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-286ef977-d8dd-4cc0-98eb-c8ea6ca572aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:33.149190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-286ef977-d8dd-4cc0-98eb-c8ea6ca572aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:33.149629 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-286ef977-d8dd-4cc0-98eb-c8ea6ca572aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:33.357948 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5ac60d35-06ba-461e-a1ed-7961c65b8d5a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:33.359946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5ac60d35-06ba-461e-a1ed-7961c65b8d5a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:33.368042 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ac60d35-06ba-461e-a1ed-7961c65b8d5a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:33.368495 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ac60d35-06ba-461e-a1ed-7961c65b8d5a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:33.369384 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ac60d35-06ba-461e-a1ed-7961c65b8d5a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:33.369815 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ac60d35-06ba-461e-a1ed-7961c65b8d5a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:33.542074 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5ac60d35-06ba-461e-a1ed-7961c65b8d5a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:33.556422 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5ac60d35-06ba-461e-a1ed-7961c65b8d5a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.202868 May 10 03:16:33.566961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 155/318] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:33 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:33.566961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a7d6d765-f5b1-4577-ae7c-0fd108342a62 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:33.566961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a7d6d765-f5b1-4577-ae7c-0fd108342a62 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:33.570428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a7d6d765-f5b1-4577-ae7c-0fd108342a62 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:33.570997 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a7d6d765-f5b1-4577-ae7c-0fd108342a62 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:33.580844 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a7d6d765-f5b1-4577-ae7c-0fd108342a62 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:33.580844 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a7d6d765-f5b1-4577-ae7c-0fd108342a62 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:33.702329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-286ef977-d8dd-4cc0-98eb-c8ea6ca572aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:33.711303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-286ef977-d8dd-4cc0-98eb-c8ea6ca572aa tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.586396 May 10 03:16:33.712265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 164/319] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:33 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:33.766580 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a7d6d765-f5b1-4577-ae7c-0fd108342a62 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:33.794667 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a7d6d765-f5b1-4577-ae7c-0fd108342a62 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1556 microversion: 2.1 time: 0.235882 May 10 03:16:33.795360 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 156/320] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:33 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:33.810982 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-646db8da-4359-438b-9100-f3b1062f2efd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:33.811479 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-646db8da-4359-438b-9100-f3b1062f2efd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:33.817511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-646db8da-4359-438b-9100-f3b1062f2efd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:33.817962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-646db8da-4359-438b-9100-f3b1062f2efd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:33.819318 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-646db8da-4359-438b-9100-f3b1062f2efd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:33.820024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-646db8da-4359-438b-9100-f3b1062f2efd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:33.910126 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-646db8da-4359-438b-9100-f3b1062f2efd tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102937 May 10 03:16:33.915436 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 165/321] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 10 03:16:33 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:34.089680 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1c2e2f9f-38e2-46ef-9099-cfc4c73ab0dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:34.090922 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1c2e2f9f-38e2-46ef-9099-cfc4c73ab0dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:34.097874 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1c2e2f9f-38e2-46ef-9099-cfc4c73ab0dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.099410 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1c2e2f9f-38e2-46ef-9099-cfc4c73ab0dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.101899 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1c2e2f9f-38e2-46ef-9099-cfc4c73ab0dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.102525 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1c2e2f9f-38e2-46ef-9099-cfc4c73ab0dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.141605 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:34.142224 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:34.151936 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.152386 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.153195 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.153684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.300375 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1c2e2f9f-38e2-46ef-9099-cfc4c73ab0dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:34.320708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1c2e2f9f-38e2-46ef-9099-cfc4c73ab0dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1319 microversion: 2.1 time: 0.232406 May 10 03:16:34.331094 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 157/322] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:34 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:34.419046 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:34.431542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:34.433186 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:34.434420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0a27c629-5a60-4734-9692-a4e37365affd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1740 microversion: 2.20 time: 0.297130 May 10 03:16:34.446012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 166/323] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:34 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:16:34.581867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1898e584-2030-4484-b823-3438d57e9a21 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:34.581867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1898e584-2030-4484-b823-3438d57e9a21 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:34.583946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1898e584-2030-4484-b823-3438d57e9a21 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.588730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1898e584-2030-4484-b823-3438d57e9a21 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.589588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1898e584-2030-4484-b823-3438d57e9a21 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.590499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1898e584-2030-4484-b823-3438d57e9a21 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.739004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8b57efd6-19c5-4113-9ce0-4f8259f3c28d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:34.739585 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8b57efd6-19c5-4113-9ce0-4f8259f3c28d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:34.749723 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8b57efd6-19c5-4113-9ce0-4f8259f3c28d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.749723 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8b57efd6-19c5-4113-9ce0-4f8259f3c28d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.750042 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8b57efd6-19c5-4113-9ce0-4f8259f3c28d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.750401 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8b57efd6-19c5-4113-9ce0-4f8259f3c28d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.815338 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1898e584-2030-4484-b823-3438d57e9a21 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:34.825464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1898e584-2030-4484-b823-3438d57e9a21 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.254123 May 10 03:16:34.826863 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 158/324] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:34 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:35.057882 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8b57efd6-19c5-4113-9ce0-4f8259f3c28d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:35.067073 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8b57efd6-19c5-4113-9ce0-4f8259f3c28d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.332394 May 10 03:16:35.067861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 167/325] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:34 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:35.338819 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0a5586ce-b85e-432e-84db-961fe71ed938 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:35.339487 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0a5586ce-b85e-432e-84db-961fe71ed938 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:35.345940 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0a5586ce-b85e-432e-84db-961fe71ed938 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.346638 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0a5586ce-b85e-432e-84db-961fe71ed938 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.347615 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0a5586ce-b85e-432e-84db-961fe71ed938 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.348204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0a5586ce-b85e-432e-84db-961fe71ed938 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.454482 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:35.457413 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:35.465881 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.466419 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.467491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.468061 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.502967 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0a5586ce-b85e-432e-84db-961fe71ed938 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:35.512267 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0a5586ce-b85e-432e-84db-961fe71ed938 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1507 microversion: 2.1 time: 0.177955 May 10 03:16:35.519198 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 159/326] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:35 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:35.785410 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-2f15ad3e-8e27-447c-ae6d-4921d13b9ecb req-0f435018-5e36-48c5-a858-e22e13bfebaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e38f9a8-3e80-482e-8726-0ce7f4da09cf", "tag": "bbc5b7a0-9d80-4868-9a66-432452cedc93"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:35.802860 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-2f15ad3e-8e27-447c-ae6d-4921d13b9ecb req-0f435018-5e36-48c5-a858-e22e13bfebaa service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.803690 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-2f15ad3e-8e27-447c-ae6d-4921d13b9ecb req-0f435018-5e36-48c5-a858-e22e13bfebaa service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.817654 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-2f15ad3e-8e27-447c-ae6d-4921d13b9ecb req-0f435018-5e36-48c5-a858-e22e13bfebaa service nova] Creating event network-changed:bbc5b7a0-9d80-4868-9a66-432452cedc93 for instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf on hv-cinder-83009 May 10 03:16:35.825479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-2f15ad3e-8e27-447c-ae6d-4921d13b9ecb req-0f435018-5e36-48c5-a858-e22e13bfebaa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045489 May 10 03:16:35.826354 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 160/327] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:35.853489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a33f391a-da71-4801-a590-a008f9470d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:35.854550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a33f391a-da71-4801-a590-a008f9470d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:35.865670 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a33f391a-da71-4801-a590-a008f9470d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.866523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a33f391a-da71-4801-a590-a008f9470d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.867820 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a33f391a-da71-4801-a590-a008f9470d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.868515 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a33f391a-da71-4801-a590-a008f9470d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.924030 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:35.932377 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:35.933946 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:35.935129 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2909bf2d-be0c-451f-a5a2-4df4bc704672 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1722 microversion: 2.20 time: 0.484705 May 10 03:16:35.935706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 168/328] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:35 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:16:36.083839 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-048eeb83-64a6-4508-85cc-44107693792b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:36.085370 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-048eeb83-64a6-4508-85cc-44107693792b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:36.100831 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-048eeb83-64a6-4508-85cc-44107693792b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:36.103710 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-048eeb83-64a6-4508-85cc-44107693792b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:36.105499 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-048eeb83-64a6-4508-85cc-44107693792b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:36.107067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-048eeb83-64a6-4508-85cc-44107693792b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:36.127874 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a33f391a-da71-4801-a590-a008f9470d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:36.135944 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a33f391a-da71-4801-a590-a008f9470d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.288659 May 10 03:16:36.136766 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 161/329] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:35 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:36.204687 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-1634dcd6-698d-4c1a-9dde-04068b58f5ff req-5ca2ec91-09a4-4b57-bb84-afa7c3b4109e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b10b34-f1d6-49fe-982c-8d00255bc565", "name": "network-vif-plugged", "status": "completed", "tag": "7b55a664-e823-4d00-8935-550519d0fdf6"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:36.218266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-1634dcd6-698d-4c1a-9dde-04068b58f5ff req-5ca2ec91-09a4-4b57-bb84-afa7c3b4109e service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:36.219178 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-1634dcd6-698d-4c1a-9dde-04068b58f5ff req-5ca2ec91-09a4-4b57-bb84-afa7c3b4109e service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:36.234653 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-1634dcd6-698d-4c1a-9dde-04068b58f5ff req-5ca2ec91-09a4-4b57-bb84-afa7c3b4109e service nova] Creating event network-vif-plugged:7b55a664-e823-4d00-8935-550519d0fdf6 for instance 80b10b34-f1d6-49fe-982c-8d00255bc565 on hv-cinder-83009 May 10 03:16:36.240239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-1634dcd6-698d-4c1a-9dde-04068b58f5ff req-5ca2ec91-09a4-4b57-bb84-afa7c3b4109e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 May 10 03:16:36.241662 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 162/330] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:16:36.473078 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-048eeb83-64a6-4508-85cc-44107693792b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:36.485986 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-048eeb83-64a6-4508-85cc-44107693792b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.405894 May 10 03:16:36.486585 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 169/331] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:36 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:36.955462 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:36.956209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:36.962882 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:36.963349 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:36.964120 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:36.964628 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:37.110191 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:37.118511 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:37.120043 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:37.122275 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9392efb6-fb9c-4610-ad1b-5132eb7fd9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1722 microversion: 2.20 time: 0.171045 May 10 03:16:37.123111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 163/332] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:36 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:37.153106 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-35bd11f2-7930-4d3c-a498-264ad06ecf35 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:37.153741 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-35bd11f2-7930-4d3c-a498-264ad06ecf35 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:37.160389 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-35bd11f2-7930-4d3c-a498-264ad06ecf35 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:37.161188 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-35bd11f2-7930-4d3c-a498-264ad06ecf35 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:37.161958 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-35bd11f2-7930-4d3c-a498-264ad06ecf35 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:37.162387 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-35bd11f2-7930-4d3c-a498-264ad06ecf35 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:37.296606 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-35bd11f2-7930-4d3c-a498-264ad06ecf35 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:37.305344 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-35bd11f2-7930-4d3c-a498-264ad06ecf35 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.156064 May 10 03:16:37.305926 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 170/333] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:37 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:37.502988 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1c978366-a013-4cf9-89c8-ae51b210c08b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:37.503516 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1c978366-a013-4cf9-89c8-ae51b210c08b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:37.510115 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1c978366-a013-4cf9-89c8-ae51b210c08b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:37.510562 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1c978366-a013-4cf9-89c8-ae51b210c08b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:37.511323 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1c978366-a013-4cf9-89c8-ae51b210c08b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:37.511754 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1c978366-a013-4cf9-89c8-ae51b210c08b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:37.646786 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1c978366-a013-4cf9-89c8-ae51b210c08b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:37.654770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1c978366-a013-4cf9-89c8-ae51b210c08b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.155791 May 10 03:16:37.655341 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 164/334] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:37 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:38.141160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:38.141767 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:38.147673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:38.148702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:38.149585 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:38.150023 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:38.278406 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:38.287421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:38.288966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:38.290603 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8912aaef-bd73-4eb4-863b-ac33098bef18 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1722 microversion: 2.20 time: 0.152787 May 10 03:16:38.291163 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 171/335] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:38 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:38.322375 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-268b8397-f049-40ac-9f30-ce0ad7acb787 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:38.322885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-268b8397-f049-40ac-9f30-ce0ad7acb787 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:38.329382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-268b8397-f049-40ac-9f30-ce0ad7acb787 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:38.329825 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-268b8397-f049-40ac-9f30-ce0ad7acb787 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:38.330580 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-268b8397-f049-40ac-9f30-ce0ad7acb787 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:38.331011 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-268b8397-f049-40ac-9f30-ce0ad7acb787 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:38.462049 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-268b8397-f049-40ac-9f30-ce0ad7acb787 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:38.469793 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-268b8397-f049-40ac-9f30-ce0ad7acb787 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.151926 May 10 03:16:38.470354 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 165/336] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:38 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:38.673238 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8771fad4-09ef-4782-aa88-19f006cd0791 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:38.673760 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8771fad4-09ef-4782-aa88-19f006cd0791 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:38.680130 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8771fad4-09ef-4782-aa88-19f006cd0791 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:38.680638 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8771fad4-09ef-4782-aa88-19f006cd0791 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:38.681462 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8771fad4-09ef-4782-aa88-19f006cd0791 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:38.682142 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8771fad4-09ef-4782-aa88-19f006cd0791 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:38.823152 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8771fad4-09ef-4782-aa88-19f006cd0791 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:38.830418 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8771fad4-09ef-4782-aa88-19f006cd0791 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.161228 May 10 03:16:38.830985 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 172/337] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:38 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:39.308935 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:39.309535 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:39.315690 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:39.316074 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:39.316850 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:39.317276 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:39.442537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:39.451734 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:39.453282 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:39.454444 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-044396f5-50a0-41d0-9071-a006c1a905d3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1722 microversion: 2.20 time: 0.149480 May 10 03:16:39.455006 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 166/338] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:39 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:39.488089 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-864dbbea-6e7d-462e-b0c7-f58cea058cea tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:39.488768 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-864dbbea-6e7d-462e-b0c7-f58cea058cea tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:39.495342 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-864dbbea-6e7d-462e-b0c7-f58cea058cea tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:39.495795 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-864dbbea-6e7d-462e-b0c7-f58cea058cea tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:39.496645 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-864dbbea-6e7d-462e-b0c7-f58cea058cea tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:39.497126 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-864dbbea-6e7d-462e-b0c7-f58cea058cea tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:39.636160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-864dbbea-6e7d-462e-b0c7-f58cea058cea tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:39.643864 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-864dbbea-6e7d-462e-b0c7-f58cea058cea tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.159927 May 10 03:16:39.644426 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 173/339] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:39 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:39.847312 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4b361c76-fc83-45e4-8cd2-f564ac4441ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:39.847843 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4b361c76-fc83-45e4-8cd2-f564ac4441ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:39.855581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b361c76-fc83-45e4-8cd2-f564ac4441ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:39.856028 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b361c76-fc83-45e4-8cd2-f564ac4441ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:39.856853 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b361c76-fc83-45e4-8cd2-f564ac4441ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:39.857295 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4b361c76-fc83-45e4-8cd2-f564ac4441ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:39.992882 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4b361c76-fc83-45e4-8cd2-f564ac4441ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:40.000142 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4b361c76-fc83-45e4-8cd2-f564ac4441ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1372 microversion: 2.1 time: 0.156700 May 10 03:16:40.000787 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 167/340] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:39 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:40.022292 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-98755d8e-7147-48bb-9e05-a45b12f35909 req-4ea619fe-11e0-4369-8505-ce61638784d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f", "name": "network-vif-unplugged", "status": "completed", "tag": "3ec8beef-b88c-43f8-8d89-f6c589198e59"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:40.031745 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-98755d8e-7147-48bb-9e05-a45b12f35909 req-4ea619fe-11e0-4369-8505-ce61638784d7 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:40.032197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-98755d8e-7147-48bb-9e05-a45b12f35909 req-4ea619fe-11e0-4369-8505-ce61638784d7 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:40.047101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-98755d8e-7147-48bb-9e05-a45b12f35909 req-4ea619fe-11e0-4369-8505-ce61638784d7 service nova] Creating event network-vif-unplugged:3ec8beef-b88c-43f8-8d89-f6c589198e59 for instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f on hv-cinder-83009 May 10 03:16:40.052424 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-98755d8e-7147-48bb-9e05-a45b12f35909 req-4ea619fe-11e0-4369-8505-ce61638784d7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033673 May 10 03:16:40.054496 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 174/341] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:40.474041 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:40.474573 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:40.481126 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:40.481567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:40.482321 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:40.482746 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:40.609810 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:40.618656 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:40.620194 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:40.621428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-399fb734-5010-42af-b3a2-a5b9ccb00368 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1665 microversion: 2.20 time: 0.151448 May 10 03:16:40.622212 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 168/342] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:40 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:40.640356 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1455dfc7-25f7-4301-88e5-112adb67e792 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "835f072c-9fbb-4e7d-bf4e-f09afd4539f3"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:40.641555 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1455dfc7-25f7-4301-88e5-112adb67e792 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:40.647725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1455dfc7-25f7-4301-88e5-112adb67e792 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:40.648174 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1455dfc7-25f7-4301-88e5-112adb67e792 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:40.649347 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1455dfc7-25f7-4301-88e5-112adb67e792 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:40.649791 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1455dfc7-25f7-4301-88e5-112adb67e792 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:40.660156 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-eb7a0198-35f8-48c7-9090-9ec40db18645 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:40.660787 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-eb7a0198-35f8-48c7-9090-9ec40db18645 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:40.667174 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-eb7a0198-35f8-48c7-9090-9ec40db18645 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:40.667622 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-eb7a0198-35f8-48c7-9090-9ec40db18645 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:40.668373 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-eb7a0198-35f8-48c7-9090-9ec40db18645 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:40.668837 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-eb7a0198-35f8-48c7-9090-9ec40db18645 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:40.803560 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-eb7a0198-35f8-48c7-9090-9ec40db18645 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:40.814616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-eb7a0198-35f8-48c7-9090-9ec40db18645 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.158189 May 10 03:16:40.816013 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 169/343] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:40 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:40.940748 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1455dfc7-25f7-4301-88e5-112adb67e792 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305120 May 10 03:16:40.941345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 175/344] 10.222.0.55 () {62 vars in 1363 bytes} [Tue May 10 03:16:40 2022] POST /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:16:41.017775 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-31d9e33c-7f8a-4689-a731-e63bd83cf498 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:41.018470 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-31d9e33c-7f8a-4689-a731-e63bd83cf498 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:41.025905 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31d9e33c-7f8a-4689-a731-e63bd83cf498 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.026566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31d9e33c-7f8a-4689-a731-e63bd83cf498 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.028282 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31d9e33c-7f8a-4689-a731-e63bd83cf498 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.029247 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31d9e33c-7f8a-4689-a731-e63bd83cf498 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.059862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d0cbaf61-d3ad-49fe-a78a-1610b9a23f04 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:41.060799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d0cbaf61-d3ad-49fe-a78a-1610b9a23f04 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:41.067393 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d0cbaf61-d3ad-49fe-a78a-1610b9a23f04 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.067900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d0cbaf61-d3ad-49fe-a78a-1610b9a23f04 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.068707 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d0cbaf61-d3ad-49fe-a78a-1610b9a23f04 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.069146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d0cbaf61-d3ad-49fe-a78a-1610b9a23f04 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.167737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d0cbaf61-d3ad-49fe-a78a-1610b9a23f04 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/action" status: 202 len: 0 microversion: 2.20 time: 0.112558 May 10 03:16:41.168482 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 176/345] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 10 03:16:41 2022] POST /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:16:41.173375 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-31d9e33c-7f8a-4689-a731-e63bd83cf498 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:41.176841 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:41.177457 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:41.183215 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-31d9e33c-7f8a-4689-a731-e63bd83cf498 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1567 microversion: 2.1 time: 0.169016 May 10 03:16:41.192903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 170/346] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:41 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:41.193240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.193240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.193240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.193240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.202517 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3597b57a-0142-40b1-a7c6-2a2b5c995057 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:41.203122 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3597b57a-0142-40b1-a7c6-2a2b5c995057 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:41.211098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3597b57a-0142-40b1-a7c6-2a2b5c995057 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.211098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3597b57a-0142-40b1-a7c6-2a2b5c995057 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.211839 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3597b57a-0142-40b1-a7c6-2a2b5c995057 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.212555 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3597b57a-0142-40b1-a7c6-2a2b5c995057 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.302656 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3597b57a-0142-40b1-a7c6-2a2b5c995057 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104568 May 10 03:16:41.303252 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 171/347] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 10 03:16:41 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:16:41.342990 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:41.351289 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:41.353140 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:41.354297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a2205b44-66c8-4687-aea6-be628c0592d9 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1751 microversion: 2.20 time: 0.181383 May 10 03:16:41.355058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 177/348] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:41 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:41.834860 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5b2aad8c-a893-44d6-89ad-03e2e7010791 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:41.836109 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5b2aad8c-a893-44d6-89ad-03e2e7010791 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:41.842938 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5b2aad8c-a893-44d6-89ad-03e2e7010791 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.843566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5b2aad8c-a893-44d6-89ad-03e2e7010791 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.844555 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5b2aad8c-a893-44d6-89ad-03e2e7010791 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.845413 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5b2aad8c-a893-44d6-89ad-03e2e7010791 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:42.270547 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5b2aad8c-a893-44d6-89ad-03e2e7010791 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:42.282749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5b2aad8c-a893-44d6-89ad-03e2e7010791 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.452546 May 10 03:16:42.283564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 172/349] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:41 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:42.372392 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:42.373059 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:42.380095 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:42.380840 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:42.382068 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:42.383205 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:42.519410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:42.528416 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:42.529952 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:42.531153 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6b5c0d82-c49f-419b-a8c2-d66dea9f2f91 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1753 microversion: 2.20 time: 0.162605 May 10 03:16:42.531974 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 178/350] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:42 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:42.624637 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-e8d85d77-e97c-45e4-8d3a-074c714d43ee req-d405fb23-d69d-4703-bc76-f6e88d2d1542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b10b34-f1d6-49fe-982c-8d00255bc565", "tag": "7b55a664-e823-4d00-8935-550519d0fdf6"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:42.633451 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-e8d85d77-e97c-45e4-8d3a-074c714d43ee req-d405fb23-d69d-4703-bc76-f6e88d2d1542 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:42.634011 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-e8d85d77-e97c-45e4-8d3a-074c714d43ee req-d405fb23-d69d-4703-bc76-f6e88d2d1542 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:42.644914 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-e8d85d77-e97c-45e4-8d3a-074c714d43ee req-d405fb23-d69d-4703-bc76-f6e88d2d1542 service nova] Creating event network-changed:7b55a664-e823-4d00-8935-550519d0fdf6 for instance 80b10b34-f1d6-49fe-982c-8d00255bc565 on hv-cinder-83009 May 10 03:16:42.651382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-e8d85d77-e97c-45e4-8d3a-074c714d43ee req-d405fb23-d69d-4703-bc76-f6e88d2d1542 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030277 May 10 03:16:42.652301 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 173/351] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:43.300373 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c8b8c1a4-2512-4fcc-8b62-a4f3178e9e23 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:43.304646 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c8b8c1a4-2512-4fcc-8b62-a4f3178e9e23 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:43.314294 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c8b8c1a4-2512-4fcc-8b62-a4f3178e9e23 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:43.315113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c8b8c1a4-2512-4fcc-8b62-a4f3178e9e23 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:43.316204 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c8b8c1a4-2512-4fcc-8b62-a4f3178e9e23 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:43.316822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c8b8c1a4-2512-4fcc-8b62-a4f3178e9e23 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:43.498118 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c8b8c1a4-2512-4fcc-8b62-a4f3178e9e23 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:43.506522 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c8b8c1a4-2512-4fcc-8b62-a4f3178e9e23 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1721 microversion: 2.1 time: 0.209963 May 10 03:16:43.507361 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 179/352] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:43 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:43.552118 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:43.552861 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:43.559428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:43.559875 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:43.560835 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:43.561272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:43.698802 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:43.707075 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:43.708564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:43.709762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-26300e5d-80aa-4a89-b1ec-de30bf2dfa71 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.162544 May 10 03:16:43.710323 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 174/353] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:43 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:44.523189 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5439c172-4f21-4bcd-97c1-dcc5868ba8ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:44.524375 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5439c172-4f21-4bcd-97c1-dcc5868ba8ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:44.530864 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5439c172-4f21-4bcd-97c1-dcc5868ba8ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.531577 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5439c172-4f21-4bcd-97c1-dcc5868ba8ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.532340 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5439c172-4f21-4bcd-97c1-dcc5868ba8ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.532805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5439c172-4f21-4bcd-97c1-dcc5868ba8ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.663512 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5439c172-4f21-4bcd-97c1-dcc5868ba8ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:44.671575 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5439c172-4f21-4bcd-97c1-dcc5868ba8ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1698 microversion: 2.1 time: 0.152244 May 10 03:16:44.672273 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 180/354] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:44 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:44.689864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-55b52f94-abd3-4c35-9ed0-c847a050e3e7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:44.698294 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-55b52f94-abd3-4c35-9ed0-c847a050e3e7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.698807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-55b52f94-abd3-4c35-9ed0-c847a050e3e7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.723219 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-55b52f94-abd3-4c35-9ed0-c847a050e3e7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Going to try to start instance {{(pid=117119) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 03:16:44.728533 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:44.730275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:44.736516 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.737209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.737985 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.738412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.780576 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-55b52f94-abd3-4c35-9ed0-c847a050e3e7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/action" status: 202 len: 0 microversion: 2.1 time: 0.095797 May 10 03:16:44.784704 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 175/355] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:16:44 2022] POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:16:44.797499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4f7749ec-2246-4b3b-8f69-2162d96ee060 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:44.798356 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4f7749ec-2246-4b3b-8f69-2162d96ee060 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:44.806980 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4f7749ec-2246-4b3b-8f69-2162d96ee060 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.807783 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4f7749ec-2246-4b3b-8f69-2162d96ee060 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.808922 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4f7749ec-2246-4b3b-8f69-2162d96ee060 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.809675 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4f7749ec-2246-4b3b-8f69-2162d96ee060 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.918151 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:44.936795 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:44.938547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:44.939995 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5ea837b9-3005-4293-b875-08e1a4481214 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.215792 May 10 03:16:44.952424 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 181/356] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:44 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:16:44.981850 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4f7749ec-2246-4b3b-8f69-2162d96ee060 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:44.990274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4f7749ec-2246-4b3b-8f69-2162d96ee060 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.199416 May 10 03:16:44.990864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 176/357] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:44 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:45.959550 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:45.960295 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:45.967335 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:45.967785 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:45.968563 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:45.969028 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:46.006993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7d86cd40-3061-4f90-bedb-87dce4ee4abf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:46.007981 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7d86cd40-3061-4f90-bedb-87dce4ee4abf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:46.015715 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d86cd40-3061-4f90-bedb-87dce4ee4abf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:46.016494 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d86cd40-3061-4f90-bedb-87dce4ee4abf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:46.017434 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d86cd40-3061-4f90-bedb-87dce4ee4abf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:46.017989 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d86cd40-3061-4f90-bedb-87dce4ee4abf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:46.155190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:46.165227 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:46.167135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:46.168582 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-79205204-6f75-4854-9301-e955a81a19ee tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.213061 May 10 03:16:46.182634 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 182/358] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:45 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:46.190794 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7d86cd40-3061-4f90-bedb-87dce4ee4abf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:46.199608 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7d86cd40-3061-4f90-bedb-87dce4ee4abf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.196317 May 10 03:16:46.200184 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 177/359] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:46 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:47.189284 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:47.190114 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:47.198386 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:47.199774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:47.201122 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:47.202431 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:47.219636 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2ef3f4c9-2f23-408d-b084-eb4720d67b7f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:47.220493 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2ef3f4c9-2f23-408d-b084-eb4720d67b7f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:47.229409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ef3f4c9-2f23-408d-b084-eb4720d67b7f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:47.230245 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ef3f4c9-2f23-408d-b084-eb4720d67b7f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:47.231903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ef3f4c9-2f23-408d-b084-eb4720d67b7f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:47.232559 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ef3f4c9-2f23-408d-b084-eb4720d67b7f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:47.388843 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:47.398074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:47.400624 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:47.402107 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-96af0330-9424-44b3-ad62-9217f010092a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.219085 May 10 03:16:47.402891 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 183/360] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:47 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:47.426953 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2ef3f4c9-2f23-408d-b084-eb4720d67b7f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:47.437313 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2ef3f4c9-2f23-408d-b084-eb4720d67b7f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.222764 May 10 03:16:47.437883 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 178/361] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:47 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:48.424732 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:48.425788 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:48.437317 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:48.437972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:48.438759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:48.439196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:48.454965 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1ca849a9-3b84-4bb0-8ccd-56d2ae38f9c6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:48.455825 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1ca849a9-3b84-4bb0-8ccd-56d2ae38f9c6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:48.463620 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1ca849a9-3b84-4bb0-8ccd-56d2ae38f9c6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:48.464342 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1ca849a9-3b84-4bb0-8ccd-56d2ae38f9c6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:48.465287 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1ca849a9-3b84-4bb0-8ccd-56d2ae38f9c6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:48.466052 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1ca849a9-3b84-4bb0-8ccd-56d2ae38f9c6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:48.604714 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:48.613464 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:48.615092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:48.616330 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-fa9990e5-eecb-4ae2-bde7-3d6336af2c90 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.197669 May 10 03:16:48.616997 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 184/362] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:48 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:48.630327 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1ca849a9-3b84-4bb0-8ccd-56d2ae38f9c6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:48.639479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1ca849a9-3b84-4bb0-8ccd-56d2ae38f9c6 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.187845 May 10 03:16:48.640299 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 179/363] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:48 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:49.636029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:49.636728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:49.643856 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:49.644389 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:49.645262 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:49.645760 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:49.657766 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-af010cf1-9b34-4caf-9afc-e42477b03378 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:49.658722 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-af010cf1-9b34-4caf-9afc-e42477b03378 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:49.666839 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af010cf1-9b34-4caf-9afc-e42477b03378 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:49.668168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af010cf1-9b34-4caf-9afc-e42477b03378 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:49.668296 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af010cf1-9b34-4caf-9afc-e42477b03378 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:49.668692 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af010cf1-9b34-4caf-9afc-e42477b03378 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:49.803563 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:49.813878 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:49.815546 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:49.816847 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6e7aedc3-9421-4e28-8d34-a50886c861b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.185376 May 10 03:16:49.817788 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 185/364] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:49 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:49.844392 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-af010cf1-9b34-4caf-9afc-e42477b03378 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:49.853038 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-af010cf1-9b34-4caf-9afc-e42477b03378 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.199003 May 10 03:16:49.853614 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 180/365] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:49 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:50.836986 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:50.838095 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:50.845978 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:50.846424 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:50.847201 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:50.847635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:50.870168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-08d1a77d-ff77-4ce3-a756-4b9556e4020c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:50.870817 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-08d1a77d-ff77-4ce3-a756-4b9556e4020c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:50.877370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-08d1a77d-ff77-4ce3-a756-4b9556e4020c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:50.877826 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-08d1a77d-ff77-4ce3-a756-4b9556e4020c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:50.878601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-08d1a77d-ff77-4ce3-a756-4b9556e4020c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:50.879041 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-08d1a77d-ff77-4ce3-a756-4b9556e4020c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:51.007629 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:51.018693 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:51.021105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:51.023035 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5031a550-b1a7-4927-ac0a-db0c5e7144f6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.189501 May 10 03:16:51.024403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 186/366] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:50 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:51.031100 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-08d1a77d-ff77-4ce3-a756-4b9556e4020c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:51.040064 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-08d1a77d-ff77-4ce3-a756-4b9556e4020c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.173702 May 10 03:16:51.040987 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 181/367] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:50 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:52.043734 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:52.044338 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:52.050451 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:52.050899 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:52.052729 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:52.052729 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:52.060208 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f889e1e3-d83f-4c0a-9e18-5575c09a1a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:52.061463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f889e1e3-d83f-4c0a-9e18-5575c09a1a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:52.082676 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f889e1e3-d83f-4c0a-9e18-5575c09a1a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:52.083129 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f889e1e3-d83f-4c0a-9e18-5575c09a1a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:52.083914 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f889e1e3-d83f-4c0a-9e18-5575c09a1a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:52.084350 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f889e1e3-d83f-4c0a-9e18-5575c09a1a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:52.198132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:52.209675 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:52.211890 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:52.214045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-fedcc492-5f01-44f1-8f5f-9e1eb76a8025 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.175017 May 10 03:16:52.215310 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 187/368] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:52 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:52.237064 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f889e1e3-d83f-4c0a-9e18-5575c09a1a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:52.244853 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f889e1e3-d83f-4c0a-9e18-5575c09a1a1f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.189229 May 10 03:16:52.245713 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 182/369] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:52 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:53.233551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:53.234247 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:53.240765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:53.241197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:53.242016 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:53.242454 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:53.264343 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-00448401-e1fb-4a83-b4bd-1eaab6e97376 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:53.264991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-00448401-e1fb-4a83-b4bd-1eaab6e97376 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:53.274404 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-00448401-e1fb-4a83-b4bd-1eaab6e97376 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:53.275260 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-00448401-e1fb-4a83-b4bd-1eaab6e97376 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:53.276240 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-00448401-e1fb-4a83-b4bd-1eaab6e97376 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:53.276906 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-00448401-e1fb-4a83-b4bd-1eaab6e97376 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:53.396712 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:53.405079 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:53.406830 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:53.407979 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-327ab3da-8b0e-4656-b769-1fff17e4c9de tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.178409 May 10 03:16:53.408536 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 188/370] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:53 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:53.416175 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-00448401-e1fb-4a83-b4bd-1eaab6e97376 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:53.423961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-00448401-e1fb-4a83-b4bd-1eaab6e97376 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.164483 May 10 03:16:53.424536 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 183/371] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:53 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:54.041995 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-20bac814-1f82-4f61-b562-a491c4a88d93 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b16bed93-259e-48e9-aee8-34f6e3d79bd8", "device": "/dev/sdb"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:54.043806 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-20bac814-1f82-4f61-b562-a491c4a88d93 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:54.049984 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-20bac814-1f82-4f61-b562-a491c4a88d93 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:54.050431 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-20bac814-1f82-4f61-b562-a491c4a88d93 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:54.051224 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-20bac814-1f82-4f61-b562-a491c4a88d93 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:54.051661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-20bac814-1f82-4f61-b562-a491c4a88d93 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:54.427580 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:54.428170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:54.436117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:54.436561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:54.437370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:54.437799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:54.590966 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:54.599819 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:54.601336 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:54.602495 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b1cfcd90-02a9-4416-82e7-5b957ea4fa21 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.179395 May 10 03:16:54.603062 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 184/372] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:54 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:16:54.607712 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e73190df-9ed0-4008-a732-1d8c8bcd702d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:54.608314 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e73190df-9ed0-4008-a732-1d8c8bcd702d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:54.614252 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e73190df-9ed0-4008-a732-1d8c8bcd702d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:54.614667 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e73190df-9ed0-4008-a732-1d8c8bcd702d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:54.615417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e73190df-9ed0-4008-a732-1d8c8bcd702d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:54.615841 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e73190df-9ed0-4008-a732-1d8c8bcd702d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:54.765189 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e73190df-9ed0-4008-a732-1d8c8bcd702d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:54.773805 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e73190df-9ed0-4008-a732-1d8c8bcd702d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.169685 May 10 03:16:54.774945 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 185/373] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:54 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:55.621602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:55.622285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:55.628354 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:55.628853 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:55.629612 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:55.630045 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:55.654528 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-20bac814-1f82-4f61-b562-a491c4a88d93 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "POST /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.617753 May 10 03:16:55.655328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 189/374] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:16:54 2022] POST /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24/os-volume_attachments => generated 194 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:55.767353 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:55.775640 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:55.777154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:55.778350 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-87a79abe-7ad4-460b-834e-06dcec361c52 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.161398 May 10 03:16:55.778905 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 186/375] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:55 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:16:55.799297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-39bd164a-ea1c-45d4-8619-65c33dd09562 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:55.799923 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-39bd164a-ea1c-45d4-8619-65c33dd09562 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:55.806182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39bd164a-ea1c-45d4-8619-65c33dd09562 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:55.806673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39bd164a-ea1c-45d4-8619-65c33dd09562 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:55.808005 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39bd164a-ea1c-45d4-8619-65c33dd09562 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:55.808443 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39bd164a-ea1c-45d4-8619-65c33dd09562 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:55.936779 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-39bd164a-ea1c-45d4-8619-65c33dd09562 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:55.944438 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-39bd164a-ea1c-45d4-8619-65c33dd09562 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.149832 May 10 03:16:55.945038 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 190/376] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:55 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:56.796932 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:56.797574 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:56.803959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:56.804404 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:56.805203 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:56.805635 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:56.933397 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:56.941613 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:56.943105 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:56.944282 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5c31ae3f-5e2d-4fa7-a039-60bc0dc4ab05 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.151288 May 10 03:16:56.944918 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 187/377] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:56 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:56.960951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8a982460-589f-44b2-a0f3-3b688abbf0b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:56.961500 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8a982460-589f-44b2-a0f3-3b688abbf0b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:56.967768 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8a982460-589f-44b2-a0f3-3b688abbf0b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:56.968215 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8a982460-589f-44b2-a0f3-3b688abbf0b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:56.969006 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8a982460-589f-44b2-a0f3-3b688abbf0b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:56.969436 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8a982460-589f-44b2-a0f3-3b688abbf0b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:57.094061 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8a982460-589f-44b2-a0f3-3b688abbf0b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:57.101811 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8a982460-589f-44b2-a0f3-3b688abbf0b4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1707 microversion: 2.1 time: 0.144743 May 10 03:16:57.102389 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 191/378] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:56 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1707 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:57.963584 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:57.964318 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:57.970644 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:57.971096 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:57.971864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:57.972303 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:58.107407 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:58.115571 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:58.117095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:58.118246 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d7c29286-b8b2-42a6-93be-634487058cba tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.159243 May 10 03:16:58.118954 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 188/379] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:57 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:16:58.119291 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d7d6fdf0-5d0f-43ae-8ced-96495cc82242 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:58.119973 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d7d6fdf0-5d0f-43ae-8ced-96495cc82242 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:58.126211 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7d6fdf0-5d0f-43ae-8ced-96495cc82242 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:58.126655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7d6fdf0-5d0f-43ae-8ced-96495cc82242 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:58.127414 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7d6fdf0-5d0f-43ae-8ced-96495cc82242 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:58.127848 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7d6fdf0-5d0f-43ae-8ced-96495cc82242 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:58.255113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d7d6fdf0-5d0f-43ae-8ced-96495cc82242 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:58.263572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d7d6fdf0-5d0f-43ae-8ced-96495cc82242 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1711 microversion: 2.1 time: 0.148174 May 10 03:16:58.264142 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 192/380] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:16:58 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1711 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:59.136512 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:59.137098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:59.143371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:59.143813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:59.144565 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:59.145029 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:59.270187 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:59.278976 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:59.280485 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:59.281971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-875cfe91-6c15-4be3-b1cc-ebdc11d180c7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.149449 May 10 03:16:59.282562 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 189/381] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:16:59 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:00.300836 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:00.301449 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:00.308517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:00.308996 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:00.309757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:00.310195 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:00.435535 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:00.443803 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:00.445350 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:00.446499 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3f2888e6-273a-4efd-bf6a-ed5d4926c895 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.149616 May 10 03:17:00.447247 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 193/382] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:00 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:01.464355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:01.465054 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:01.472031 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:01.472473 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:01.473269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:01.473696 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:01.600772 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:01.608870 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:01.610353 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:01.611500 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-280b64a0-de66-490a-bed5-e095886a0044 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.151581 May 10 03:17:01.612052 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 190/383] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:01 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:02.629528 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:02.630135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:02.636562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:02.637042 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:02.637799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:02.638228 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:02.764150 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:02.772359 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:02.773895 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:02.775600 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-60c68321-f50d-4714-97f6-9376ee5a893f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.149478 May 10 03:17:02.776354 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 194/384] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:02 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:03.794311 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:03.794819 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:03.801265 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:03.801710 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:03.802470 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:03.802896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:03.932998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:03.941185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:03.942819 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:03.943984 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9116ea96-09ba-44ad-a459-3662af0bf984 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.153872 May 10 03:17:03.944547 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 191/385] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:03 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:04.962025 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:04.963911 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:04.969740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:04.970203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:04.970972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:04.971411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:05.097806 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:05.105949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:05.107435 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:05.108581 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-997cfbdd-8f4a-45c3-a6e7-0c76d13738c2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.150466 May 10 03:17:05.109168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 195/386] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:04 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:06.127179 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:06.127784 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:06.134023 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:06.134465 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:06.135731 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:06.136156 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:06.261763 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:06.269939 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:06.271484 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:06.272666 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9e3ce33f-638c-4b3c-af56-93c2b60706cb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.149411 May 10 03:17:06.273239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 192/387] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:06 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:07.291423 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:07.292035 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:07.298430 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:07.298877 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:07.299637 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:07.300071 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:07.425859 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:07.434752 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:07.436244 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:07.437440 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-893abcb2-3402-4567-ae5d-15624a429e01 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.150064 May 10 03:17:07.438020 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 196/388] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:07 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:08.182119 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-5872b5ea-980d-4550-affc-f29867f1b68a req-8c0feb5b-43b9-4eee-940c-d854326338fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f", "name": "network-vif-plugged", "status": "completed", "tag": "3ec8beef-b88c-43f8-8d89-f6c589198e59"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:08.190569 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-5872b5ea-980d-4550-affc-f29867f1b68a req-8c0feb5b-43b9-4eee-940c-d854326338fa service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:08.191049 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-5872b5ea-980d-4550-affc-f29867f1b68a req-8c0feb5b-43b9-4eee-940c-d854326338fa service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:08.202694 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-5872b5ea-980d-4550-affc-f29867f1b68a req-8c0feb5b-43b9-4eee-940c-d854326338fa service nova] Creating event network-vif-plugged:3ec8beef-b88c-43f8-8d89-f6c589198e59 for instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f on hv-cinder-83009 May 10 03:17:08.207695 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-5872b5ea-980d-4550-affc-f29867f1b68a req-8c0feb5b-43b9-4eee-940c-d854326338fa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029491 May 10 03:17:08.208288 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 193/389] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:08.455505 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:08.456117 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:08.462528 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:08.463678 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:08.464425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:08.465113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:08.603138 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:08.612133 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:08.614969 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:08.616996 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1196c16d-4ad5-4a76-9d64-882b66cca8ac tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.165269 May 10 03:17:08.617563 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 197/390] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:08 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:17:09.637584 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:09.638315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:09.644508 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:09.644990 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:09.645763 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:09.646196 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:09.775692 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:09.784078 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:09.785581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:09.786722 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b53e77bc-77a4-4801-83c7-cd28bbb97d8b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.154622 May 10 03:17:09.787279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 194/391] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:09 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:10.804625 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:10.805258 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:10.811587 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:10.812033 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:10.812837 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:10.813275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:10.942179 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:10.950999 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:10.952486 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:10.953660 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-df2c1d58-5344-450e-9d61-ba5e82e61b93 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.152957 May 10 03:17:10.954220 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 198/392] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:10 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:11.971248 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:11.971841 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:11.977860 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:11.978422 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:11.979212 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:11.979654 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:12.108443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:12.116732 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:12.118228 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:12.120076 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-29a86ec5-40db-44b2-90fc-b8885239d03e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.152741 May 10 03:17:12.120550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 195/393] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:11 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:13.138744 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:13.139346 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:13.145658 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:13.146103 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:13.146861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:13.147291 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:13.273609 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:13.282003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:13.283488 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:13.284631 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b989d640-e7bf-4476-af91-bed6b0d51ea7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.150446 May 10 03:17:13.285225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 199/394] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:13 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:14.303084 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:14.303711 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:14.310423 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:14.310875 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:14.311635 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:14.312067 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:14.437076 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:14.445780 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:14.447833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:14.449022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a969d798-6824-43eb-bb29-56aade7f08d7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.149944 May 10 03:17:14.449579 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 196/395] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:14 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:15.467746 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:15.468720 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:15.474699 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:15.475151 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:15.475916 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:15.476351 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:15.600681 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:15.609794 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:15.611299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:15.612460 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-fd0dc1ca-388b-4a29-a891-0d179efae2ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.148859 May 10 03:17:15.613066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 200/396] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:15 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:16.631144 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:16.631796 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:16.638448 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:16.638906 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:16.639682 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:16.640119 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:16.783445 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:16.793937 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:16.796519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:16.798484 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9f35ee0f-f904-41de-9637-0902537f1aff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.171136 May 10 03:17:16.799422 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 197/397] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:16 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:17.818901 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:17.819517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:17.826082 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:17.826527 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:17.827311 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:17.827749 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:17.961093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:17.970164 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:17.971696 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:17.972899 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-993023a8-99ff-4f93-ac8c-3a4ac70d0fdc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1809 microversion: 2.20 time: 0.157998 May 10 03:17:17.973468 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 201/398] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:17 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:17:18.990966 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:18.991621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:18.998577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:18.999024 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:18.999787 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:19.000221 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:19.132706 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:19.141124 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:19.142616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:19.143774 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-15b88f02-0c87-4c68-afe3-55b7d1b89b36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1796 microversion: 2.20 time: 0.156754 May 10 03:17:19.144338 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 198/399] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:17:18 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:20.315973 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9c8e50fe-4618-48a0-8a49-adf1a7864f2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:20.316432 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9c8e50fe-4618-48a0-8a49-adf1a7864f2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:20.323852 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c8e50fe-4618-48a0-8a49-adf1a7864f2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:20.324309 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c8e50fe-4618-48a0-8a49-adf1a7864f2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:20.325113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c8e50fe-4618-48a0-8a49-adf1a7864f2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:20.325556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c8e50fe-4618-48a0-8a49-adf1a7864f2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:20.447675 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-9c8e50fe-4618-48a0-8a49-adf1a7864f2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lazy-loading 'services' on Instance uuid c1a714b2-630e-4616-9da3-f0acae26fb24 {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:17:20.561451 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9c8e50fe-4618-48a0-8a49-adf1a7864f2a tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24/os-volume_attachments/b16bed93-259e-48e9-aee8-34f6e3d79bd8" status: 202 len: 0 microversion: 2.1 time: 0.249218 May 10 03:17:20.562069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 202/400] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:17:20 2022] DELETE /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24/os-volume_attachments/b16bed93-259e-48e9-aee8-34f6e3d79bd8 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:17:21.673256 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f71cab37-f388-468e-9628-d172eb53f67b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:21.673749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f71cab37-f388-468e-9628-d172eb53f67b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:21.679996 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f71cab37-f388-468e-9628-d172eb53f67b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:21.680444 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f71cab37-f388-468e-9628-d172eb53f67b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:21.681236 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f71cab37-f388-468e-9628-d172eb53f67b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:21.682194 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f71cab37-f388-468e-9628-d172eb53f67b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:21.707024 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f71cab37-f388-468e-9628-d172eb53f67b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:17:21.780407 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f71cab37-f388-468e-9628-d172eb53f67b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 204 len: 0 microversion: 2.1 time: 0.110522 May 10 03:17:21.781482 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 199/401] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:17:21 2022] DELETE /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:17:21.791632 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8876162c-65c8-478e-8b1b-11df55788b97 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:21.792703 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8876162c-65c8-478e-8b1b-11df55788b97 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:21.798352 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8876162c-65c8-478e-8b1b-11df55788b97 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:21.798798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8876162c-65c8-478e-8b1b-11df55788b97 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:21.799558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8876162c-65c8-478e-8b1b-11df55788b97 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:21.799998 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8876162c-65c8-478e-8b1b-11df55788b97 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:21.925976 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8876162c-65c8-478e-8b1b-11df55788b97 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:21.933814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8876162c-65c8-478e-8b1b-11df55788b97 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1513 microversion: 2.1 time: 0.147677 May 10 03:17:21.934383 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 203/402] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:21 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:22.952270 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e7bac727-a331-4e60-94f4-aa0995afcfb4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:22.952988 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e7bac727-a331-4e60-94f4-aa0995afcfb4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:22.959196 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e7bac727-a331-4e60-94f4-aa0995afcfb4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:22.959640 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e7bac727-a331-4e60-94f4-aa0995afcfb4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:22.960396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e7bac727-a331-4e60-94f4-aa0995afcfb4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:22.960858 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e7bac727-a331-4e60-94f4-aa0995afcfb4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:23.089977 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e7bac727-a331-4e60-94f4-aa0995afcfb4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:23.097208 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e7bac727-a331-4e60-94f4-aa0995afcfb4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1513 microversion: 2.1 time: 0.149783 May 10 03:17:23.097776 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 200/403] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:22 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:24.114498 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-40a7d66e-0264-4d4c-a716-5ef58355ba7d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:24.115125 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-40a7d66e-0264-4d4c-a716-5ef58355ba7d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:24.122072 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-40a7d66e-0264-4d4c-a716-5ef58355ba7d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:24.122664 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-40a7d66e-0264-4d4c-a716-5ef58355ba7d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:24.123445 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-40a7d66e-0264-4d4c-a716-5ef58355ba7d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:24.123874 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-40a7d66e-0264-4d4c-a716-5ef58355ba7d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:24.214698 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-40a7d66e-0264-4d4c-a716-5ef58355ba7d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:24.222128 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-40a7d66e-0264-4d4c-a716-5ef58355ba7d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 200 len: 1471 microversion: 2.1 time: 0.111899 May 10 03:17:24.222703 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 204/404] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:24 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 1471 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:24.248035 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-e761e9d3-3581-4adb-acff-053c852364da req-04d91780-ed1c-47bf-99bd-81733f20f8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a714b2-630e-4616-9da3-f0acae26fb24", "name": "network-vif-deleted", "tag": "d0ecc293-10f4-407f-97ea-01ab5c2dbe91"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:24.256725 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-e761e9d3-3581-4adb-acff-053c852364da req-04d91780-ed1c-47bf-99bd-81733f20f8c3 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:24.257315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-e761e9d3-3581-4adb-acff-053c852364da req-04d91780-ed1c-47bf-99bd-81733f20f8c3 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:24.268230 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-e761e9d3-3581-4adb-acff-053c852364da req-04d91780-ed1c-47bf-99bd-81733f20f8c3 service nova] Creating event network-vif-deleted:d0ecc293-10f4-407f-97ea-01ab5c2dbe91 for instance c1a714b2-630e-4616-9da3-f0acae26fb24 on hv-cinder-83009 May 10 03:17:24.273424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-e761e9d3-3581-4adb-acff-053c852364da req-04d91780-ed1c-47bf-99bd-81733f20f8c3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029581 May 10 03:17:24.274059 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 201/405] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:25.239900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:25.240506 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: c1a714b2-630e-4616-9da3-f0acae26fb24] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:25.247070 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:25.247513 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:25.248299 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:25.248758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:25.261949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] HTTP exception thrown: Instance c1a714b2-630e-4616-9da3-f0acae26fb24 could not be found. May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Request method failure captured: May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 HTTP/1.1 May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedkA4Ev_4Tm-t1Fiq8LvXqRYGh1d1pOhs5WwRCu3OtzgNxCZy7NODRTYgTtAPLdvJ9LoZ4tc1GmBWs6jSQ7NcniProjyiH48fxqZvtc7eBzBMyxMzpIoUGfov8BVrVpSaQPGv_IGdoqsdxFyBITAqpMetZ4fUD2OrmoQVgtXKnYzH2w May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 7c623f8bafbe4349a313eef2b75c8154 May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1239410557 May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:17:25.263547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7c623f8bafbe4349a313eef2b75c8154"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7c623f8bafbe4349a313eef2b75c8154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7c623f8bafbe4349a313eef2b75c8154", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7c623f8bafbe4349a313eef2b75c8154"}]}] May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-VolumesSnapshotTestJSON-1239410557 May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 7c623f8bafbe4349a313eef2b75c8154 May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1239410557 May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-VolumesSnapshotTestJSON-1239410557-project May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 1f176581b3794d139a4546d6aef2b959 May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-VolumesSnapshotTestJSON-1239410557-project May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance c1a714b2-630e-4616-9da3-f0acae26fb24 could not be found. May 10 03:17:25.265101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': 'c1a714b2-630e-4616-9da3-f0acae26fb24'} May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a714b2-630e-4616-9da3-f0acae26fb24 could not be found. May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:17:25.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a714b2-630e-4616-9da3-f0acae26fb24 could not be found. May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a714b2-630e-4616-9da3-f0acae26fb24 could not be found. May 10 03:17:25.267270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:17:25.268304 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Returning 404 to user: Instance c1a714b2-630e-4616-9da3-f0acae26fb24 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:17:25.268304 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c2b55a57-ffab-458a-9257-36382def74df tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24" status: 404 len: 111 microversion: 2.1 time: 0.028848 May 10 03:17:25.268304 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 205/406] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:25 2022] GET /compute/v2.1/servers/c1a714b2-630e-4616-9da3-f0acae26fb24 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:17:33.036458 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-584352323", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "networks": [{"uuid": "1de77f49-b9d8-4f50-8c23-0e4791428a47"}]}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:33.088682 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] validate_networks() for [('1de77f49-b9d8-4f50-8c23-0e4791428a47', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:17:33.426395 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:17:33.426811 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:17:33.427305 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:17:33.427707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:17:33.428113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:17:33.437339 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:33.437777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:33.438564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:33.438988 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:33.455520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Getting quotas for project 7c623f8bafbe4349a313eef2b75c8154. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:17:33.459378 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Getting quotas for user 1f176581b3794d139a4546d6aef2b959 and project 7c623f8bafbe4349a313eef2b75c8154. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:17:33.470211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:17:33.472504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:17:33.515931 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e54ec38e-6828-41fd-97ce-cc9619a77eb7 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483390 May 10 03:17:33.516572 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 202/407] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:17:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:17:33.526392 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0673feea-3056-434e-be30-627ca1ef3d70 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:33.526975 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0673feea-3056-434e-be30-627ca1ef3d70 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:33.579092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0673feea-3056-434e-be30-627ca1ef3d70 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:33.585528 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0673feea-3056-434e-be30-627ca1ef3d70 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1218 microversion: 2.1 time: 0.063098 May 10 03:17:33.586082 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 206/408] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:33 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:34.602315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-774fc006-887e-494d-aa5a-d7db418752b6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:34.602929 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-774fc006-887e-494d-aa5a-d7db418752b6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:34.610084 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-774fc006-887e-494d-aa5a-d7db418752b6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:34.610598 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-774fc006-887e-494d-aa5a-d7db418752b6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:34.611648 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-774fc006-887e-494d-aa5a-d7db418752b6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:34.612157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-774fc006-887e-494d-aa5a-d7db418752b6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:34.685091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-774fc006-887e-494d-aa5a-d7db418752b6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:34.693271 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-774fc006-887e-494d-aa5a-d7db418752b6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1288 microversion: 2.1 time: 0.095207 May 10 03:17:34.694040 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 203/409] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:34 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:17:35.711291 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cdbd5fec-db00-419a-95ee-d10ddc27bab9 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:35.711932 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-cdbd5fec-db00-419a-95ee-d10ddc27bab9 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:35.719269 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cdbd5fec-db00-419a-95ee-d10ddc27bab9 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:35.719719 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cdbd5fec-db00-419a-95ee-d10ddc27bab9 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:35.720485 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cdbd5fec-db00-419a-95ee-d10ddc27bab9 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:35.721007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cdbd5fec-db00-419a-95ee-d10ddc27bab9 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:35.784832 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-5c7aca4b-39ea-43dc-a0c3-bf12ae553aef req-06d6212b-9dce-4b67-ae59-19c5c12adb51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f8dd94-00ab-409a-82f3-734c6bc9e294", "tag": "0854563f-6713-4e37-8fa0-66d7c2d1331f"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:35.793609 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-5c7aca4b-39ea-43dc-a0c3-bf12ae553aef req-06d6212b-9dce-4b67-ae59-19c5c12adb51 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:35.794059 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-5c7aca4b-39ea-43dc-a0c3-bf12ae553aef req-06d6212b-9dce-4b67-ae59-19c5c12adb51 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:35.805122 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-5c7aca4b-39ea-43dc-a0c3-bf12ae553aef req-06d6212b-9dce-4b67-ae59-19c5c12adb51 service nova] Creating event network-changed:0854563f-6713-4e37-8fa0-66d7c2d1331f for instance 87f8dd94-00ab-409a-82f3-734c6bc9e294 on hv-cinder-83009 May 10 03:17:35.810904 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-5c7aca4b-39ea-43dc-a0c3-bf12ae553aef req-06d6212b-9dce-4b67-ae59-19c5c12adb51 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030765 May 10 03:17:35.811529 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 204/410] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:35.952473 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-cdbd5fec-db00-419a-95ee-d10ddc27bab9 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:35.959716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-cdbd5fec-db00-419a-95ee-d10ddc27bab9 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1318 microversion: 2.1 time: 0.252283 May 10 03:17:35.960278 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 207/411] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:35 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:36.977833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-444e2bb6-0e15-4a3c-8845-e1f888860cd1 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:36.978833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-444e2bb6-0e15-4a3c-8845-e1f888860cd1 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:36.985028 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-444e2bb6-0e15-4a3c-8845-e1f888860cd1 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:36.985503 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-444e2bb6-0e15-4a3c-8845-e1f888860cd1 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:36.986263 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-444e2bb6-0e15-4a3c-8845-e1f888860cd1 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:36.986690 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-444e2bb6-0e15-4a3c-8845-e1f888860cd1 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:37.110858 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-444e2bb6-0e15-4a3c-8845-e1f888860cd1 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:37.118098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-444e2bb6-0e15-4a3c-8845-e1f888860cd1 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1318 microversion: 2.1 time: 0.144896 May 10 03:17:37.118678 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 205/412] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:36 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:38.134800 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-75d7d4b6-0107-4eca-870e-1aeed2f5373e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:38.135420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-75d7d4b6-0107-4eca-870e-1aeed2f5373e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:38.141881 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-75d7d4b6-0107-4eca-870e-1aeed2f5373e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:38.142333 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-75d7d4b6-0107-4eca-870e-1aeed2f5373e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:38.144033 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-75d7d4b6-0107-4eca-870e-1aeed2f5373e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:38.144499 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-75d7d4b6-0107-4eca-870e-1aeed2f5373e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:38.273706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-75d7d4b6-0107-4eca-870e-1aeed2f5373e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:38.281788 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-75d7d4b6-0107-4eca-870e-1aeed2f5373e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1318 microversion: 2.1 time: 0.151017 May 10 03:17:38.282350 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 208/413] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:38 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:39.298983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cf23e07d-ac2a-4c42-81e1-23f56a2f7002 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:39.299568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-cf23e07d-ac2a-4c42-81e1-23f56a2f7002 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:39.305885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cf23e07d-ac2a-4c42-81e1-23f56a2f7002 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:39.306468 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cf23e07d-ac2a-4c42-81e1-23f56a2f7002 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:39.307257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cf23e07d-ac2a-4c42-81e1-23f56a2f7002 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:39.307684 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cf23e07d-ac2a-4c42-81e1-23f56a2f7002 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:39.435393 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-cf23e07d-ac2a-4c42-81e1-23f56a2f7002 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:39.442690 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-cf23e07d-ac2a-4c42-81e1-23f56a2f7002 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1318 microversion: 2.1 time: 0.147542 May 10 03:17:39.443250 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 206/414] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:39 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:40.459505 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6cde399d-0863-46a1-a740-1e584e3f53a6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:40.460117 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6cde399d-0863-46a1-a740-1e584e3f53a6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:40.467568 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6cde399d-0863-46a1-a740-1e584e3f53a6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:40.467990 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6cde399d-0863-46a1-a740-1e584e3f53a6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:40.468797 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6cde399d-0863-46a1-a740-1e584e3f53a6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:40.469232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6cde399d-0863-46a1-a740-1e584e3f53a6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:40.596988 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6cde399d-0863-46a1-a740-1e584e3f53a6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:40.604401 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6cde399d-0863-46a1-a740-1e584e3f53a6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1318 microversion: 2.1 time: 0.148797 May 10 03:17:40.605001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 209/415] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:40 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:41.621529 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-069374fe-8c7d-4ee5-b6b5-de099489d023 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:41.622140 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-069374fe-8c7d-4ee5-b6b5-de099489d023 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:41.628149 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-069374fe-8c7d-4ee5-b6b5-de099489d023 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:41.628599 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-069374fe-8c7d-4ee5-b6b5-de099489d023 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:41.629389 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-069374fe-8c7d-4ee5-b6b5-de099489d023 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:41.629825 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-069374fe-8c7d-4ee5-b6b5-de099489d023 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:41.754070 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-069374fe-8c7d-4ee5-b6b5-de099489d023 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:41.761424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-069374fe-8c7d-4ee5-b6b5-de099489d023 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1318 microversion: 2.1 time: 0.144642 May 10 03:17:41.761982 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 207/416] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:41 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:42.444182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-c589bf90-de4f-4583-805b-39904b4a39f0 req-cdd89204-2ed3-424e-ab79-0fec560a17ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f8dd94-00ab-409a-82f3-734c6bc9e294", "name": "network-vif-plugged", "status": "completed", "tag": "0854563f-6713-4e37-8fa0-66d7c2d1331f"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:42.453934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-c589bf90-de4f-4583-805b-39904b4a39f0 req-cdd89204-2ed3-424e-ab79-0fec560a17ab service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:42.454664 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-c589bf90-de4f-4583-805b-39904b4a39f0 req-cdd89204-2ed3-424e-ab79-0fec560a17ab service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:42.469205 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-c589bf90-de4f-4583-805b-39904b4a39f0 req-cdd89204-2ed3-424e-ab79-0fec560a17ab service nova] Creating event network-vif-plugged:0854563f-6713-4e37-8fa0-66d7c2d1331f for instance 87f8dd94-00ab-409a-82f3-734c6bc9e294 on hv-cinder-83009 May 10 03:17:42.474502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-c589bf90-de4f-4583-805b-39904b4a39f0 req-cdd89204-2ed3-424e-ab79-0fec560a17ab service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 May 10 03:17:42.475107 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 210/417] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:42.777869 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5fa594cd-b127-4ee9-9432-4f76771a288d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:42.778534 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5fa594cd-b127-4ee9-9432-4f76771a288d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:42.785091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5fa594cd-b127-4ee9-9432-4f76771a288d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:42.785541 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5fa594cd-b127-4ee9-9432-4f76771a288d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:42.786312 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5fa594cd-b127-4ee9-9432-4f76771a288d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:42.786746 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5fa594cd-b127-4ee9-9432-4f76771a288d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:42.910527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5fa594cd-b127-4ee9-9432-4f76771a288d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:42.918372 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5fa594cd-b127-4ee9-9432-4f76771a288d tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1318 microversion: 2.1 time: 0.144320 May 10 03:17:42.918940 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 208/418] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:42 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:43.297371 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e32b747d-0727-49ec-8c46-4a4fe1812492 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:43.297942 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e32b747d-0727-49ec-8c46-4a4fe1812492 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:43.303971 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e32b747d-0727-49ec-8c46-4a4fe1812492 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.304424 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e32b747d-0727-49ec-8c46-4a4fe1812492 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:43.305214 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e32b747d-0727-49ec-8c46-4a4fe1812492 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.305648 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e32b747d-0727-49ec-8c46-4a4fe1812492 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:43.329178 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e32b747d-0727-49ec-8c46-4a4fe1812492 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf/ips" status: 200 len: 149 microversion: 2.1 time: 0.035961 May 10 03:17:43.329743 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 211/419] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:17:43 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:43.340257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c323508-dd15-4528-9de7-827ec8686306"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:43.341409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:43.347523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.347971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:43.348818 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.349249 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:43.426875 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Invalid volume: volume 1c323508-dd15-4528-9de7-827ec8686306 is already attached to instances: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: POST /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf/os-volume_attachments HTTP/1.1 May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 74 May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:17:43.428582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {"volumeAttachment": {"volumeId": "1c323508-dd15-4528-9de7-827ec8686306"}} May 10 03:17:43.430113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Invalid volume: volume 1c323508-dd15-4528-9de7-827ec8686306 is already attached to instances: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'server_id': '5e38f9a8-3e80-482e-8726-0ce7f4da09cf', 'body': {'volumeAttachment': {'volumeId': '1c323508-dd15-4528-9de7-827ec8686306'}}} May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1c323508-dd15-4528-9de7-827ec8686306 is already attached to instances: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:43.431673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1c323508-dd15-4528-9de7-827ec8686306 is already attached to instances: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:17:43.433154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:17:43.434537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:17:43.434537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:17:43.434537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:17:43.434537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1c323508-dd15-4528-9de7-827ec8686306 is already attached to instances: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb May 10 03:17:43.434537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:43.434537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 400 to user: Invalid volume: volume 1c323508-dd15-4528-9de7-827ec8686306 is already attached to instances: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:17:43.434537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0cbd7f43-bed3-47a4-8f08-b8de9d3eb94e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094057 May 10 03:17:43.434537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 209/420] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:17:43 2022] POST /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 03:17:43.440026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e42f108b-7fa3-4ada-90f7-b3cc2ae286f7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:43.440525 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e42f108b-7fa3-4ada-90f7-b3cc2ae286f7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:43.446539 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e42f108b-7fa3-4ada-90f7-b3cc2ae286f7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.448035 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e42f108b-7fa3-4ada-90f7-b3cc2ae286f7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:43.448851 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e42f108b-7fa3-4ada-90f7-b3cc2ae286f7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.449293 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e42f108b-7fa3-4ada-90f7-b3cc2ae286f7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:43.474801 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e42f108b-7fa3-4ada-90f7-b3cc2ae286f7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:17:43.555734 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e42f108b-7fa3-4ada-90f7-b3cc2ae286f7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 204 len: 0 microversion: 2.1 time: 0.119238 May 10 03:17:43.557164 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 212/421] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:17:43 2022] DELETE /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:17:43.565121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-64a63b40-edbb-441b-96e4-174618e90e76 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:43.565797 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-64a63b40-edbb-441b-96e4-174618e90e76 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:43.573128 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-64a63b40-edbb-441b-96e4-174618e90e76 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.573323 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-64a63b40-edbb-441b-96e4-174618e90e76 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:43.574069 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-64a63b40-edbb-441b-96e4-174618e90e76 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.574505 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-64a63b40-edbb-441b-96e4-174618e90e76 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:43.703606 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-64a63b40-edbb-441b-96e4-174618e90e76 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:43.710896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-64a63b40-edbb-441b-96e4-174618e90e76 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1681 microversion: 2.1 time: 0.149574 May 10 03:17:43.711466 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 210/422] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:43 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:43.936360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4afe383a-9659-4791-9619-4ffab437863e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:43.937011 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4afe383a-9659-4791-9619-4ffab437863e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:43.942962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4afe383a-9659-4791-9619-4ffab437863e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.943411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4afe383a-9659-4791-9619-4ffab437863e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:43.944167 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4afe383a-9659-4791-9619-4ffab437863e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:43.944594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4afe383a-9659-4791-9619-4ffab437863e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:44.070647 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4afe383a-9659-4791-9619-4ffab437863e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:44.077965 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4afe383a-9659-4791-9619-4ffab437863e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1318 microversion: 2.1 time: 0.146812 May 10 03:17:44.078530 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 213/423] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:43 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:44.729981 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ea9d3b39-5632-4f33-b4d1-45059ed3a871 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:44.730592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ea9d3b39-5632-4f33-b4d1-45059ed3a871 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:44.737375 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea9d3b39-5632-4f33-b4d1-45059ed3a871 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:44.737840 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea9d3b39-5632-4f33-b4d1-45059ed3a871 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:44.738589 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea9d3b39-5632-4f33-b4d1-45059ed3a871 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:44.739073 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ea9d3b39-5632-4f33-b4d1-45059ed3a871 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:44.869667 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ea9d3b39-5632-4f33-b4d1-45059ed3a871 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:44.876951 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ea9d3b39-5632-4f33-b4d1-45059ed3a871 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1681 microversion: 2.1 time: 0.151082 May 10 03:17:44.877521 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 211/424] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:44 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:45.094595 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-25c3c650-a758-4560-aaae-3ece8a4d43dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:45.095203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-25c3c650-a758-4560-aaae-3ece8a4d43dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:45.101569 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-25c3c650-a758-4560-aaae-3ece8a4d43dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:45.102020 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-25c3c650-a758-4560-aaae-3ece8a4d43dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:45.103437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-25c3c650-a758-4560-aaae-3ece8a4d43dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:45.103971 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-25c3c650-a758-4560-aaae-3ece8a4d43dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:45.234865 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-25c3c650-a758-4560-aaae-3ece8a4d43dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:45.242323 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-25c3c650-a758-4560-aaae-3ece8a4d43dc tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1318 microversion: 2.1 time: 0.151570 May 10 03:17:45.242894 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 214/425] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:45 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:45.896489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-106e2f36-0f7e-496d-bb35-c02b26b33109 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:45.897116 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-106e2f36-0f7e-496d-bb35-c02b26b33109 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:45.904207 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-106e2f36-0f7e-496d-bb35-c02b26b33109 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:45.904667 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-106e2f36-0f7e-496d-bb35-c02b26b33109 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:45.905439 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-106e2f36-0f7e-496d-bb35-c02b26b33109 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:45.905866 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-106e2f36-0f7e-496d-bb35-c02b26b33109 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:46.034839 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-106e2f36-0f7e-496d-bb35-c02b26b33109 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:46.042130 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-106e2f36-0f7e-496d-bb35-c02b26b33109 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1681 microversion: 2.1 time: 0.149954 May 10 03:17:46.042703 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 212/426] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:45 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:46.259839 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-98b7aa25-cd5f-46c4-87f7-1ee773d46906 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:46.260572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-98b7aa25-cd5f-46c4-87f7-1ee773d46906 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:46.266906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-98b7aa25-cd5f-46c4-87f7-1ee773d46906 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:46.267357 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-98b7aa25-cd5f-46c4-87f7-1ee773d46906 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:46.268127 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-98b7aa25-cd5f-46c4-87f7-1ee773d46906 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:46.268594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-98b7aa25-cd5f-46c4-87f7-1ee773d46906 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:46.754774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-98b7aa25-cd5f-46c4-87f7-1ee773d46906 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:46.762646 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-98b7aa25-cd5f-46c4-87f7-1ee773d46906 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1507 microversion: 2.1 time: 0.507260 May 10 03:17:46.763225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 215/427] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:46 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:46.779852 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ce6731c9-ebbf-42c8-a130-81133de132b4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0ad9306-0559-4c1d-b3f4-d4aced56194f", "device": "/dev/sdb"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:46.781843 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ce6731c9-ebbf-42c8-a130-81133de132b4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:46.787609 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ce6731c9-ebbf-42c8-a130-81133de132b4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:46.788060 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ce6731c9-ebbf-42c8-a130-81133de132b4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:46.788853 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ce6731c9-ebbf-42c8-a130-81133de132b4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:46.789288 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ce6731c9-ebbf-42c8-a130-81133de132b4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:47.060839 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ce6731c9-ebbf-42c8-a130-81133de132b4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "POST /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284391 May 10 03:17:47.062286 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 213/428] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:17:46 2022] POST /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:47.071209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-26edff6b-2d11-4172-a03f-184be9ecdaaa tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:47.073104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-26edff6b-2d11-4172-a03f-184be9ecdaaa tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:47.086307 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-26edff6b-2d11-4172-a03f-184be9ecdaaa tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:47.087915 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-26edff6b-2d11-4172-a03f-184be9ecdaaa tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:47.089200 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-26edff6b-2d11-4172-a03f-184be9ecdaaa tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:47.090215 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-26edff6b-2d11-4172-a03f-184be9ecdaaa tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:47.204153 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-26edff6b-2d11-4172-a03f-184be9ecdaaa tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:47.211850 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-26edff6b-2d11-4172-a03f-184be9ecdaaa tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 200 len: 1613 microversion: 2.1 time: 0.156042 May 10 03:17:47.213480 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 216/429] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:47 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 1613 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:47.324249 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-42cda086-632a-40ad-a1ab-2af0d2086d4b req-15d432c4-4eb6-42ed-8b8a-079835d1c85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e38f9a8-3e80-482e-8726-0ce7f4da09cf", "name": "network-vif-deleted", "tag": "bbc5b7a0-9d80-4868-9a66-432452cedc93"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:47.333476 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-42cda086-632a-40ad-a1ab-2af0d2086d4b req-15d432c4-4eb6-42ed-8b8a-079835d1c85b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:47.334183 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-42cda086-632a-40ad-a1ab-2af0d2086d4b req-15d432c4-4eb6-42ed-8b8a-079835d1c85b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:47.346743 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-42cda086-632a-40ad-a1ab-2af0d2086d4b req-15d432c4-4eb6-42ed-8b8a-079835d1c85b service nova] Creating event network-vif-deleted:bbc5b7a0-9d80-4868-9a66-432452cedc93 for instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf on hv-cinder-83009 May 10 03:17:47.352539 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-42cda086-632a-40ad-a1ab-2af0d2086d4b req-15d432c4-4eb6-42ed-8b8a-079835d1c85b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033968 May 10 03:17:47.353733 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 214/430] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:47.457147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4600bb0f-22a3-4377-9629-5baf3d1ae617 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21801b4d-6b83-4277-915b-4d67b365a666"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:47.458943 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4600bb0f-22a3-4377-9629-5baf3d1ae617 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:47.466491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4600bb0f-22a3-4377-9629-5baf3d1ae617 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:47.466987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4600bb0f-22a3-4377-9629-5baf3d1ae617 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:47.467759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4600bb0f-22a3-4377-9629-5baf3d1ae617 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:47.468368 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4600bb0f-22a3-4377-9629-5baf3d1ae617 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:48.001939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4600bb0f-22a3-4377-9629-5baf3d1ae617 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.548815 May 10 03:17:48.002785 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 217/431] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:17:47 2022] POST /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:48.231549 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:48.232257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:48.238753 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:48.239198 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:48.239974 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:48.240407 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:48.256021 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf HTTP/1.1 May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:17:48.257707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:17:48.258958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '5e38f9a8-3e80-482e-8726-0ce7f4da09cf'} May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:17:48.259671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:17:48.260897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:17:48.262002 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:17:48.262002 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a4265343-beb4-488e-bd2d-c5b0f90d9ae8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 404 len: 111 microversion: 2.1 time: 0.032447 May 10 03:17:48.262002 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 215/432] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:17:48 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:17:48.269718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-551fb392-cc8a-4bfc-a5d5-795335aecb4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '.version_select at 0x7f1497e03d30>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:48.297261 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-551fb392-cc8a-4bfc-a5d5-795335aecb4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571105423" status: 202 len: 0 microversion: 2.1 time: 0.031856 May 10 03:17:48.300686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 218/433] 10.222.0.55 () {58 vars in 1220 bytes} [Tue May 10 03:17:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571105423 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:17:49.021469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7a0338d9-1025-4170-8ee2-e24558c2faff tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:49.021963 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7a0338d9-1025-4170-8ee2-e24558c2faff tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:49.029673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a0338d9-1025-4170-8ee2-e24558c2faff tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:49.030121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a0338d9-1025-4170-8ee2-e24558c2faff tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:49.030895 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a0338d9-1025-4170-8ee2-e24558c2faff tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:49.031576 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a0338d9-1025-4170-8ee2-e24558c2faff tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:49.156319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-7a0338d9-1025-4170-8ee2-e24558c2faff tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lazy-loading 'services' on Instance uuid e867a0c9-e715-4ac3-8be5-1bb4e64f56fb {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:17:49.276815 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7a0338d9-1025-4170-8ee2-e24558c2faff tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments/1c323508-dd15-4528-9de7-827ec8686306" status: 202 len: 0 microversion: 2.1 time: 0.259017 May 10 03:17:49.277569 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 216/434] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:17:49 2022] DELETE /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments/1c323508-dd15-4528-9de7-827ec8686306 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:17:49.285916 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e4b2cfa9-b124-445f-865c-c3cfad77958b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:49.287075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e4b2cfa9-b124-445f-865c-c3cfad77958b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:49.294869 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfa9-b124-445f-865c-c3cfad77958b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:49.295402 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfa9-b124-445f-865c-c3cfad77958b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:49.296440 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfa9-b124-445f-865c-c3cfad77958b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:49.296949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfa9-b124-445f-865c-c3cfad77958b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:49.327277 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e4b2cfa9-b124-445f-865c-c3cfad77958b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045061 May 10 03:17:49.331406 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 219/435] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:49 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:49.612300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-311ffada-f8b9-4987-82f6-b508bee73529 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:49.612910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-311ffada-f8b9-4987-82f6-b508bee73529 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:49.619919 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-311ffada-f8b9-4987-82f6-b508bee73529 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:49.620364 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-311ffada-f8b9-4987-82f6-b508bee73529 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:49.621208 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-311ffada-f8b9-4987-82f6-b508bee73529 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:49.621588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-311ffada-f8b9-4987-82f6-b508bee73529 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:49.700557 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-311ffada-f8b9-4987-82f6-b508bee73529 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lazy-loading 'services' on Instance uuid 03eee221-c04f-48de-b2eb-5e696a377e0f {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:17:49.770169 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-311ffada-f8b9-4987-82f6-b508bee73529 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "DELETE /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/os-volume_attachments/9ab91f5c-b50b-4270-a578-d3071e593cd6" status: 202 len: 0 microversion: 2.1 time: 0.161976 May 10 03:17:49.770753 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 217/436] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:17:49 2022] DELETE /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/os-volume_attachments/9ab91f5c-b50b-4270-a578-d3071e593cd6 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:17:50.339781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-73630c26-d794-4e24-a339-41c318010555 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:50.340726 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-73630c26-d794-4e24-a339-41c318010555 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:50.347131 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-73630c26-d794-4e24-a339-41c318010555 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:50.347676 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-73630c26-d794-4e24-a339-41c318010555 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:50.348455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-73630c26-d794-4e24-a339-41c318010555 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:50.348947 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-73630c26-d794-4e24-a339-41c318010555 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:50.378550 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-73630c26-d794-4e24-a339-41c318010555 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 May 10 03:17:50.379053 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 220/437] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:50 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:51.390846 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4859c5ba-cdf2-4c31-92fa-37667cc46565 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:51.391803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4859c5ba-cdf2-4c31-92fa-37667cc46565 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:51.398136 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4859c5ba-cdf2-4c31-92fa-37667cc46565 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:51.398591 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4859c5ba-cdf2-4c31-92fa-37667cc46565 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:51.399477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4859c5ba-cdf2-4c31-92fa-37667cc46565 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:51.400415 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4859c5ba-cdf2-4c31-92fa-37667cc46565 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:51.429792 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4859c5ba-cdf2-4c31-92fa-37667cc46565 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043737 May 10 03:17:51.430347 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 218/438] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:51 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:52.442328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-71e8432b-52ad-4ad3-a2f5-66b8c8abd005 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:52.443240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-71e8432b-52ad-4ad3-a2f5-66b8c8abd005 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:52.449822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-71e8432b-52ad-4ad3-a2f5-66b8c8abd005 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:52.450275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-71e8432b-52ad-4ad3-a2f5-66b8c8abd005 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:52.451046 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-71e8432b-52ad-4ad3-a2f5-66b8c8abd005 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:52.451482 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-71e8432b-52ad-4ad3-a2f5-66b8c8abd005 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:52.482292 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-71e8432b-52ad-4ad3-a2f5-66b8c8abd005 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043876 May 10 03:17:52.482778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 221/439] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:52 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:53.493730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-494633a5-c08e-4a18-ad90-a2f60f09b184 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:53.494670 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-494633a5-c08e-4a18-ad90-a2f60f09b184 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:53.501097 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-494633a5-c08e-4a18-ad90-a2f60f09b184 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:53.501549 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-494633a5-c08e-4a18-ad90-a2f60f09b184 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:53.502310 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-494633a5-c08e-4a18-ad90-a2f60f09b184 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:53.502743 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-494633a5-c08e-4a18-ad90-a2f60f09b184 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:53.531670 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-494633a5-c08e-4a18-ad90-a2f60f09b184 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041677 May 10 03:17:53.532148 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 219/440] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:53 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:54.543112 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0e7a8b49-b1e8-4e07-ac56-d6e4cbc2703e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:54.544153 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0e7a8b49-b1e8-4e07-ac56-d6e4cbc2703e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:54.550449 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0e7a8b49-b1e8-4e07-ac56-d6e4cbc2703e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:54.550894 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0e7a8b49-b1e8-4e07-ac56-d6e4cbc2703e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:54.551654 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0e7a8b49-b1e8-4e07-ac56-d6e4cbc2703e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:54.552074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0e7a8b49-b1e8-4e07-ac56-d6e4cbc2703e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:54.583655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0e7a8b49-b1e8-4e07-ac56-d6e4cbc2703e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 May 10 03:17:54.584218 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 222/441] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:54 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:55.595329 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-011bc0c1-80aa-49c6-9728-b4a5c6d56f26 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:55.596242 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-011bc0c1-80aa-49c6-9728-b4a5c6d56f26 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:55.603300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-011bc0c1-80aa-49c6-9728-b4a5c6d56f26 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:55.603741 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-011bc0c1-80aa-49c6-9728-b4a5c6d56f26 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:55.604508 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-011bc0c1-80aa-49c6-9728-b4a5c6d56f26 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:55.604972 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-011bc0c1-80aa-49c6-9728-b4a5c6d56f26 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:55.633316 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-011bc0c1-80aa-49c6-9728-b4a5c6d56f26 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 May 10 03:17:55.633958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 220/442] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:55 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:56.644899 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a79c49d1-2b21-4e4a-b297-10ff11d420b6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:56.645855 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a79c49d1-2b21-4e4a-b297-10ff11d420b6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:56.652958 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a79c49d1-2b21-4e4a-b297-10ff11d420b6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:56.653410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a79c49d1-2b21-4e4a-b297-10ff11d420b6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:56.654180 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a79c49d1-2b21-4e4a-b297-10ff11d420b6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:56.654615 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a79c49d1-2b21-4e4a-b297-10ff11d420b6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:56.683099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a79c49d1-2b21-4e4a-b297-10ff11d420b6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042139 May 10 03:17:56.683589 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 223/443] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:56 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:57.694511 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9953e2e9-be4e-4abf-98f0-cada7706b3a9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:57.695427 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9953e2e9-be4e-4abf-98f0-cada7706b3a9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:57.702048 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9953e2e9-be4e-4abf-98f0-cada7706b3a9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:57.702502 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9953e2e9-be4e-4abf-98f0-cada7706b3a9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:57.703257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9953e2e9-be4e-4abf-98f0-cada7706b3a9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:57.703687 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9953e2e9-be4e-4abf-98f0-cada7706b3a9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:57.733042 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9953e2e9-be4e-4abf-98f0-cada7706b3a9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 May 10 03:17:57.733771 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 221/444] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:57 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:58.744475 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4498386f-b68a-4dd5-8fd0-55f2d8d04fa4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:58.745436 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4498386f-b68a-4dd5-8fd0-55f2d8d04fa4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:58.751839 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4498386f-b68a-4dd5-8fd0-55f2d8d04fa4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:58.752245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4498386f-b68a-4dd5-8fd0-55f2d8d04fa4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:58.753060 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4498386f-b68a-4dd5-8fd0-55f2d8d04fa4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:58.753496 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4498386f-b68a-4dd5-8fd0-55f2d8d04fa4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:58.783970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4498386f-b68a-4dd5-8fd0-55f2d8d04fa4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043417 May 10 03:17:58.784537 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 224/445] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:58 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:59.795139 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-58fb176c-3fbf-4528-8aee-fc5e5b1fa562 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:59.796051 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-58fb176c-3fbf-4528-8aee-fc5e5b1fa562 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:59.802368 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-58fb176c-3fbf-4528-8aee-fc5e5b1fa562 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:59.802842 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-58fb176c-3fbf-4528-8aee-fc5e5b1fa562 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:59.803600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-58fb176c-3fbf-4528-8aee-fc5e5b1fa562 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:59.804028 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-58fb176c-3fbf-4528-8aee-fc5e5b1fa562 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:59.832425 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-58fb176c-3fbf-4528-8aee-fc5e5b1fa562 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041213 May 10 03:17:59.832950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 222/446] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:17:59 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:00.844281 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-114ea7ae-acbe-48a4-a5f5-20580697f54e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:00.845232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-114ea7ae-acbe-48a4-a5f5-20580697f54e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:00.851494 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-114ea7ae-acbe-48a4-a5f5-20580697f54e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:00.851939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-114ea7ae-acbe-48a4-a5f5-20580697f54e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:00.852727 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-114ea7ae-acbe-48a4-a5f5-20580697f54e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:00.853168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-114ea7ae-acbe-48a4-a5f5-20580697f54e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:00.889877 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-114ea7ae-acbe-48a4-a5f5-20580697f54e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049400 May 10 03:18:00.890361 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 225/447] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:18:00 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:01.892179 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fc5dcb8d-129c-4c9c-ba6f-25da3560fa6e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:01.892723 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fc5dcb8d-129c-4c9c-ba6f-25da3560fa6e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:01.899216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fc5dcb8d-129c-4c9c-ba6f-25da3560fa6e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:01.899665 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fc5dcb8d-129c-4c9c-ba6f-25da3560fa6e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:01.900981 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fc5dcb8d-129c-4c9c-ba6f-25da3560fa6e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:01.901416 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fc5dcb8d-129c-4c9c-ba6f-25da3560fa6e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:01.901592 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9e97ec7c-1d1e-4610-8136-9fea425e46a8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:01.902551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9e97ec7c-1d1e-4610-8136-9fea425e46a8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:01.909276 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9e97ec7c-1d1e-4610-8136-9fea425e46a8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:01.909747 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9e97ec7c-1d1e-4610-8136-9fea425e46a8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:01.910511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9e97ec7c-1d1e-4610-8136-9fea425e46a8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:01.910940 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9e97ec7c-1d1e-4610-8136-9fea425e46a8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:01.930074 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fc5dcb8d-129c-4c9c-ba6f-25da3560fa6e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments/835f072c-9fbb-4e7d-bf4e-f09afd4539f3" status: 200 len: 194 microversion: 2.20 time: 0.041800 May 10 03:18:01.930662 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 223/448] 10.222.0.55 () {60 vars in 1453 bytes} [Tue May 10 03:18:01 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments/835f072c-9fbb-4e7d-bf4e-f09afd4539f3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:18:01.941108 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9e97ec7c-1d1e-4610-8136-9fea425e46a8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 May 10 03:18:01.941831 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 226/449] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:18:01 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:01.992992 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-12ceda09-861b-4c3c-908d-67f63394f3be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:01.993500 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-12ceda09-861b-4c3c-908d-67f63394f3be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:01.999305 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-12ceda09-861b-4c3c-908d-67f63394f3be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:01.999763 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-12ceda09-861b-4c3c-908d-67f63394f3be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:02.000536 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-12ceda09-861b-4c3c-908d-67f63394f3be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:02.001009 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-12ceda09-861b-4c3c-908d-67f63394f3be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:02.081209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-12ceda09-861b-4c3c-908d-67f63394f3be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lazy-loading 'services' on Instance uuid 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:18:02.151238 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-12ceda09-861b-4c3c-908d-67f63394f3be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments/835f072c-9fbb-4e7d-bf4e-f09afd4539f3" status: 202 len: 0 microversion: 2.20 time: 0.161394 May 10 03:18:02.155101 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 224/450] 10.222.0.55 () {60 vars in 1456 bytes} [Tue May 10 03:18:01 2022] DELETE /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments/835f072c-9fbb-4e7d-bf4e-f09afd4539f3 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:18:02.160876 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6edc0b2c-8e60-4fd6-886c-2a1fe0529335 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:02.161981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6edc0b2c-8e60-4fd6-886c-2a1fe0529335 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:02.168230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6edc0b2c-8e60-4fd6-886c-2a1fe0529335 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:02.168711 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6edc0b2c-8e60-4fd6-886c-2a1fe0529335 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:02.169471 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6edc0b2c-8e60-4fd6-886c-2a1fe0529335 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:02.169912 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6edc0b2c-8e60-4fd6-886c-2a1fe0529335 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:02.205662 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6edc0b2c-8e60-4fd6-886c-2a1fe0529335 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048854 May 10 03:18:02.206286 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 227/451] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 10 03:18:02 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:18:02.837310 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fcaec729-56e8-41db-9ceb-13e8896de56b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:02.839132 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fcaec729-56e8-41db-9ceb-13e8896de56b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:02.845251 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fcaec729-56e8-41db-9ceb-13e8896de56b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:02.845635 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fcaec729-56e8-41db-9ceb-13e8896de56b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:02.846389 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fcaec729-56e8-41db-9ceb-13e8896de56b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:02.846816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fcaec729-56e8-41db-9ceb-13e8896de56b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:02.869453 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-fcaec729-56e8-41db-9ceb-13e8896de56b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lazy-loading 'flavor' on Instance uuid 80b10b34-f1d6-49fe-982c-8d00255bc565 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:18:02.952598 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c60395d8-1159-4ed6-a223-ce754392071d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:02.953547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c60395d8-1159-4ed6-a223-ce754392071d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:02.959757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c60395d8-1159-4ed6-a223-ce754392071d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:02.960218 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c60395d8-1159-4ed6-a223-ce754392071d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:02.961005 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c60395d8-1159-4ed6-a223-ce754392071d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:02.961441 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c60395d8-1159-4ed6-a223-ce754392071d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:02.989270 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fcaec729-56e8-41db-9ceb-13e8896de56b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/action" status: 200 len: 32 microversion: 2.1 time: 0.156096 May 10 03:18:02.990240 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 225/452] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:18:02 2022] POST /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:18:02.999332 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8f29ed02-bbab-41c6-88c1-99dd6d2e00b6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:03.000013 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8f29ed02-bbab-41c6-88c1-99dd6d2e00b6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:03.001511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c60395d8-1159-4ed6-a223-ce754392071d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052774 May 10 03:18:03.002402 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 228/453] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:18:02 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:03.006497 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8f29ed02-bbab-41c6-88c1-99dd6d2e00b6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:03.006945 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8f29ed02-bbab-41c6-88c1-99dd6d2e00b6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:03.007771 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8f29ed02-bbab-41c6-88c1-99dd6d2e00b6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:03.008215 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8f29ed02-bbab-41c6-88c1-99dd6d2e00b6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:03.146931 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8f29ed02-bbab-41c6-88c1-99dd6d2e00b6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:03.158633 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8f29ed02-bbab-41c6-88c1-99dd6d2e00b6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.163438 May 10 03:18:03.159524 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 226/454] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:02 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:03.217830 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b924f563-adb3-4299-8db4-117bf6c06d1f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:03.218758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b924f563-adb3-4299-8db4-117bf6c06d1f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:03.225743 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b924f563-adb3-4299-8db4-117bf6c06d1f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:03.226694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b924f563-adb3-4299-8db4-117bf6c06d1f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:03.227476 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b924f563-adb3-4299-8db4-117bf6c06d1f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:03.227917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b924f563-adb3-4299-8db4-117bf6c06d1f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:03.257771 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b924f563-adb3-4299-8db4-117bf6c06d1f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044205 May 10 03:18:03.258375 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 229/455] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 10 03:18:03 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:18:04.013427 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4d45654a-2b99-4411-ae75-34923acd6f7c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:04.014358 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4d45654a-2b99-4411-ae75-34923acd6f7c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:04.020782 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4d45654a-2b99-4411-ae75-34923acd6f7c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.021248 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4d45654a-2b99-4411-ae75-34923acd6f7c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.022027 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4d45654a-2b99-4411-ae75-34923acd6f7c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.022464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4d45654a-2b99-4411-ae75-34923acd6f7c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.051620 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4d45654a-2b99-4411-ae75-34923acd6f7c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042595 May 10 03:18:04.052188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 227/456] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:18:04 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:18:04.109774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f1562972-d843-4081-b846-f14d2d4c1991 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:04.110264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f1562972-d843-4081-b846-f14d2d4c1991 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:04.116478 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f1562972-d843-4081-b846-f14d2d4c1991 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.116951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f1562972-d843-4081-b846-f14d2d4c1991 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.117716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f1562972-d843-4081-b846-f14d2d4c1991 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.118145 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f1562972-d843-4081-b846-f14d2d4c1991 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.142969 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f1562972-d843-4081-b846-f14d2d4c1991 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:18:04.177494 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4d3460af-5b68-46ac-a97f-ca765c132e0a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:04.178229 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4d3460af-5b68-46ac-a97f-ca765c132e0a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:04.185573 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4d3460af-5b68-46ac-a97f-ca765c132e0a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.186018 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4d3460af-5b68-46ac-a97f-ca765c132e0a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.186787 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4d3460af-5b68-46ac-a97f-ca765c132e0a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.187212 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4d3460af-5b68-46ac-a97f-ca765c132e0a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.241172 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f1562972-d843-4081-b846-f14d2d4c1991 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 204 len: 0 microversion: 2.1 time: 0.134749 May 10 03:18:04.242146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 230/457] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:18:04 2022] DELETE /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:18:04.251068 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-135a28df-b86e-405a-9023-111764880e9c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:04.251770 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-135a28df-b86e-405a-9023-111764880e9c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:04.257817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-135a28df-b86e-405a-9023-111764880e9c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.258266 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-135a28df-b86e-405a-9023-111764880e9c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.259701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-135a28df-b86e-405a-9023-111764880e9c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.259701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-135a28df-b86e-405a-9023-111764880e9c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.333774 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4d3460af-5b68-46ac-a97f-ca765c132e0a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:04.344546 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4d3460af-5b68-46ac-a97f-ca765c132e0a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.171243 May 10 03:18:04.345181 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 228/458] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:04 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:04.349869 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fe8903e8-72d2-4bb9-8504-e0f2a740cf40 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:04.350893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fe8903e8-72d2-4bb9-8504-e0f2a740cf40 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:04.357503 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fe8903e8-72d2-4bb9-8504-e0f2a740cf40 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.357954 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fe8903e8-72d2-4bb9-8504-e0f2a740cf40 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.358711 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fe8903e8-72d2-4bb9-8504-e0f2a740cf40 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.359134 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fe8903e8-72d2-4bb9-8504-e0f2a740cf40 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.388472 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fe8903e8-72d2-4bb9-8504-e0f2a740cf40 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041964 May 10 03:18:04.389167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 229/459] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 10 03:18:04 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:18:04.419802 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-135a28df-b86e-405a-9023-111764880e9c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:04.427196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-135a28df-b86e-405a-9023-111764880e9c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1680 microversion: 2.1 time: 0.180407 May 10 03:18:04.427765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 231/460] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:04 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:04.576485 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-77d4d23d-0046-449a-b2f2-d37fabe82579 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:04.583997 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-77d4d23d-0046-449a-b2f2-d37fabe82579 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.584427 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-77d4d23d-0046-449a-b2f2-d37fabe82579 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.609376 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-77d4d23d-0046-449a-b2f2-d37fabe82579 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Going to try to stop instance {{(pid=117119) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 03:18:04.650040 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-77d4d23d-0046-449a-b2f2-d37fabe82579 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/action" status: 202 len: 0 microversion: 2.1 time: 0.082392 May 10 03:18:04.650637 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 230/461] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:18:04 2022] POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:18:04.659578 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-66dd9bee-b71e-42b9-bc6f-5d04114a0697 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:04.660194 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-66dd9bee-b71e-42b9-bc6f-5d04114a0697 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:04.666716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-66dd9bee-b71e-42b9-bc6f-5d04114a0697 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.667107 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-66dd9bee-b71e-42b9-bc6f-5d04114a0697 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.667862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-66dd9bee-b71e-42b9-bc6f-5d04114a0697 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:04.668288 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-66dd9bee-b71e-42b9-bc6f-5d04114a0697 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:04.793907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-66dd9bee-b71e-42b9-bc6f-5d04114a0697 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:04.801155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-66dd9bee-b71e-42b9-bc6f-5d04114a0697 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.145748 May 10 03:18:04.801754 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 232/462] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:04 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:05.362779 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-83ce8ee2-f039-4ed4-912d-888079b8262b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:05.363474 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-83ce8ee2-f039-4ed4-912d-888079b8262b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:05.370071 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83ce8ee2-f039-4ed4-912d-888079b8262b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.370594 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83ce8ee2-f039-4ed4-912d-888079b8262b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.371374 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83ce8ee2-f039-4ed4-912d-888079b8262b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.371844 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83ce8ee2-f039-4ed4-912d-888079b8262b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.375534 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-16a65554-48e9-45b1-b31c-1a0d3a108373 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:05.376028 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-16a65554-48e9-45b1-b31c-1a0d3a108373 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:05.382197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-16a65554-48e9-45b1-b31c-1a0d3a108373 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.382636 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-16a65554-48e9-45b1-b31c-1a0d3a108373 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.383399 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-16a65554-48e9-45b1-b31c-1a0d3a108373 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.383828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-16a65554-48e9-45b1-b31c-1a0d3a108373 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.463632 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-16a65554-48e9-45b1-b31c-1a0d3a108373 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lazy-loading 'services' on Instance uuid 87f8dd94-00ab-409a-82f3-734c6bc9e294 {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:18:05.504065 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-83ce8ee2-f039-4ed4-912d-888079b8262b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:05.511940 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-83ce8ee2-f039-4ed4-912d-888079b8262b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.153776 May 10 03:18:05.512513 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 231/463] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:05 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:05.517110 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-82dddb8e-d1df-42ad-8bc0-476da495a587 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:05.518045 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-82dddb8e-d1df-42ad-8bc0-476da495a587 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:05.523626 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-82dddb8e-d1df-42ad-8bc0-476da495a587 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.524081 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-82dddb8e-d1df-42ad-8bc0-476da495a587 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.525337 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-82dddb8e-d1df-42ad-8bc0-476da495a587 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.525904 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-82dddb8e-d1df-42ad-8bc0-476da495a587 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.543024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-16a65554-48e9-45b1-b31c-1a0d3a108373 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "DELETE /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294/os-volume_attachments/d0ad9306-0559-4c1d-b3f4-d4aced56194f" status: 202 len: 0 microversion: 2.1 time: 0.172377 May 10 03:18:05.543624 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 233/464] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:18:05 2022] DELETE /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294/os-volume_attachments/d0ad9306-0559-4c1d-b3f4-d4aced56194f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:18:05.549169 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3e1fd59f-0988-48e5-8ba0-9fe2f7ce60e0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:05.549527 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3e1fd59f-0988-48e5-8ba0-9fe2f7ce60e0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:05.555593 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3e1fd59f-0988-48e5-8ba0-9fe2f7ce60e0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.556016 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3e1fd59f-0988-48e5-8ba0-9fe2f7ce60e0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.557540 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3e1fd59f-0988-48e5-8ba0-9fe2f7ce60e0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.558157 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3e1fd59f-0988-48e5-8ba0-9fe2f7ce60e0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.563404 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-82dddb8e-d1df-42ad-8bc0-476da495a587 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049824 May 10 03:18:05.563987 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 232/465] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 10 03:18:05 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:18:05.690197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3e1fd59f-0988-48e5-8ba0-9fe2f7ce60e0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:05.698136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3e1fd59f-0988-48e5-8ba0-9fe2f7ce60e0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1680 microversion: 2.1 time: 0.153350 May 10 03:18:05.698701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 234/466] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:05 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:05.817679 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ac213289-4324-4844-bba3-e452db02b5e8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:05.818289 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ac213289-4324-4844-bba3-e452db02b5e8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:05.824195 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ac213289-4324-4844-bba3-e452db02b5e8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.824642 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ac213289-4324-4844-bba3-e452db02b5e8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.825427 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ac213289-4324-4844-bba3-e452db02b5e8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.825856 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ac213289-4324-4844-bba3-e452db02b5e8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.948862 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ac213289-4324-4844-bba3-e452db02b5e8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:05.956102 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ac213289-4324-4844-bba3-e452db02b5e8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.142262 May 10 03:18:05.956765 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 233/467] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:05 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:06.529172 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dc28e5be-d5df-4d6f-a271-92cfd0f3c2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:06.529789 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-dc28e5be-d5df-4d6f-a271-92cfd0f3c2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:06.538719 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc28e5be-d5df-4d6f-a271-92cfd0f3c2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:06.539171 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc28e5be-d5df-4d6f-a271-92cfd0f3c2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:06.539961 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc28e5be-d5df-4d6f-a271-92cfd0f3c2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:06.540397 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc28e5be-d5df-4d6f-a271-92cfd0f3c2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:06.574392 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1d9fc91d-18f6-480a-ae6f-e5da68769738 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:06.575288 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1d9fc91d-18f6-480a-ae6f-e5da68769738 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:06.581884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1d9fc91d-18f6-480a-ae6f-e5da68769738 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:06.582336 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1d9fc91d-18f6-480a-ae6f-e5da68769738 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:06.583113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1d9fc91d-18f6-480a-ae6f-e5da68769738 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:06.583754 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1d9fc91d-18f6-480a-ae6f-e5da68769738 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:06.617971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1d9fc91d-18f6-480a-ae6f-e5da68769738 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047761 May 10 03:18:06.618537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 234/468] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 10 03:18:06 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:18:06.715472 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2b8959e3-1def-4f62-8537-cbab569466bc tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:06.716238 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2b8959e3-1def-4f62-8537-cbab569466bc tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:06.722578 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2b8959e3-1def-4f62-8537-cbab569466bc tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:06.723057 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2b8959e3-1def-4f62-8537-cbab569466bc tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:06.723850 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2b8959e3-1def-4f62-8537-cbab569466bc tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:06.724279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2b8959e3-1def-4f62-8537-cbab569466bc tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:06.803377 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-dc28e5be-d5df-4d6f-a271-92cfd0f3c2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:06.813325 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-dc28e5be-d5df-4d6f-a271-92cfd0f3c2d5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.288479 May 10 03:18:06.814046 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 235/469] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:06 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:06.973411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1208eb0d-0ffb-4453-a539-97ece55c6027 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:06.973935 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1208eb0d-0ffb-4453-a539-97ece55c6027 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:06.980859 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1208eb0d-0ffb-4453-a539-97ece55c6027 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:06.981311 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1208eb0d-0ffb-4453-a539-97ece55c6027 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:06.982105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1208eb0d-0ffb-4453-a539-97ece55c6027 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:06.982540 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1208eb0d-0ffb-4453-a539-97ece55c6027 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.067604 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2b8959e3-1def-4f62-8537-cbab569466bc tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:07.075074 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2b8959e3-1def-4f62-8537-cbab569466bc tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1680 microversion: 2.1 time: 0.363921 May 10 03:18:07.075758 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 235/470] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:06 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1680 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:07.193848 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1208eb0d-0ffb-4453-a539-97ece55c6027 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:07.218948 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1208eb0d-0ffb-4453-a539-97ece55c6027 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.249306 May 10 03:18:07.219532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 236/471] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:06 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:07.579609 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-47679460-4ac5-44de-beb4-d71f888c43f7 req-25268761-b21e-4e40-86af-fc427c860ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e867a0c9-e715-4ac3-8be5-1bb4e64f56fb", "name": "network-vif-deleted", "tag": "ca4610dc-9a2b-4dfa-a722-526e08fec54d"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:07.588809 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-47679460-4ac5-44de-beb4-d71f888c43f7 req-25268761-b21e-4e40-86af-fc427c860ad6 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.589489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-47679460-4ac5-44de-beb4-d71f888c43f7 req-25268761-b21e-4e40-86af-fc427c860ad6 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.600815 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-47679460-4ac5-44de-beb4-d71f888c43f7 req-25268761-b21e-4e40-86af-fc427c860ad6 service nova] Creating event network-vif-deleted:ca4610dc-9a2b-4dfa-a722-526e08fec54d for instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb on hv-cinder-83009 May 10 03:18:07.607246 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-47679460-4ac5-44de-beb4-d71f888c43f7 req-25268761-b21e-4e40-86af-fc427c860ad6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032286 May 10 03:18:07.608238 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 236/472] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:07.632992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-84faaee7-1a0c-4de3-b5b0-0612cf9f1dcb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:07.637395 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-84faaee7-1a0c-4de3-b5b0-0612cf9f1dcb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:07.645056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84faaee7-1a0c-4de3-b5b0-0612cf9f1dcb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.645616 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84faaee7-1a0c-4de3-b5b0-0612cf9f1dcb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.646619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84faaee7-1a0c-4de3-b5b0-0612cf9f1dcb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.647451 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-84faaee7-1a0c-4de3-b5b0-0612cf9f1dcb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.698538 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-84faaee7-1a0c-4de3-b5b0-0612cf9f1dcb tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071573 May 10 03:18:07.699282 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 237/473] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 10 03:18:07 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:07.733773 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e49aca50-e788-4749-a589-5509451c786e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:07.734576 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e49aca50-e788-4749-a589-5509451c786e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:07.741894 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e49aca50-e788-4749-a589-5509451c786e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.742341 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e49aca50-e788-4749-a589-5509451c786e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.743153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e49aca50-e788-4749-a589-5509451c786e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.743581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e49aca50-e788-4749-a589-5509451c786e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.773339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-da3e4c69-2199-452d-a37d-06fddfe10690 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:07.773855 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-da3e4c69-2199-452d-a37d-06fddfe10690 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:07.775799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e49aca50-e788-4749-a589-5509451c786e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:18:07.782045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da3e4c69-2199-452d-a37d-06fddfe10690 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.782774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da3e4c69-2199-452d-a37d-06fddfe10690 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.783587 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da3e4c69-2199-452d-a37d-06fddfe10690 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.784173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da3e4c69-2199-452d-a37d-06fddfe10690 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.813519 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-da3e4c69-2199-452d-a37d-06fddfe10690 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:18:07.880472 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e49aca50-e788-4749-a589-5509451c786e tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "DELETE /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 204 len: 0 microversion: 2.1 time: 0.150571 May 10 03:18:07.881260 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 237/474] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:18:07 2022] DELETE /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:18:07.890735 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0de7f49d-9c14-44ef-b3ae-5b55503ec724 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:07.891626 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0de7f49d-9c14-44ef-b3ae-5b55503ec724 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:07.897631 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0de7f49d-9c14-44ef-b3ae-5b55503ec724 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.897990 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0de7f49d-9c14-44ef-b3ae-5b55503ec724 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.898806 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0de7f49d-9c14-44ef-b3ae-5b55503ec724 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.899249 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0de7f49d-9c14-44ef-b3ae-5b55503ec724 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.908940 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-da3e4c69-2199-452d-a37d-06fddfe10690 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 204 len: 0 microversion: 2.20 time: 0.139132 May 10 03:18:07.912900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 238/475] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 10 03:18:07 2022] DELETE /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 03:18:07.917577 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2daaa3d2-b449-49e9-8a5f-5bc6036ae4e4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:07.917577 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2daaa3d2-b449-49e9-8a5f-5bc6036ae4e4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:07.923787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2daaa3d2-b449-49e9-8a5f-5bc6036ae4e4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.924313 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2daaa3d2-b449-49e9-8a5f-5bc6036ae4e4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:07.925175 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2daaa3d2-b449-49e9-8a5f-5bc6036ae4e4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:07.925672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2daaa3d2-b449-49e9-8a5f-5bc6036ae4e4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:08.064507 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0de7f49d-9c14-44ef-b3ae-5b55503ec724 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:08.073531 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0de7f49d-9c14-44ef-b3ae-5b55503ec724 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.187118 May 10 03:18:08.074220 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 238/476] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:07 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:08.079353 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:08.079959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:08.086030 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:08.086823 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:08.088153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:08.089308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:08.108832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2daaa3d2-b449-49e9-8a5f-5bc6036ae4e4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:08.116721 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2daaa3d2-b449-49e9-8a5f-5bc6036ae4e4 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1513 microversion: 2.1 time: 0.205011 May 10 03:18:08.117266 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 239/477] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:07 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:08.124001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:08.124716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:08.131569 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:08.132023 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:08.132844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:08.133285 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:08.166709 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:08.167165 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:08.167625 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lazy-loading 'fault' on Instance uuid e867a0c9-e715-4ac3-8be5-1bb4e64f56fb {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:18:08.215715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:08.223124 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6adec59d-8e95-4c50-b089-3df523eccad5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1332 microversion: 2.1 time: 0.104814 May 10 03:18:08.224582 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 240/478] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:08 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:08.236564 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cd69837f-ae92-4ca0-bda1-1895fc7fc589 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:08.237209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-cd69837f-ae92-4ca0-bda1-1895fc7fc589 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:08.239645 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:08.243187 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cd69837f-ae92-4ca0-bda1-1895fc7fc589 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:08.244212 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cd69837f-ae92-4ca0-bda1-1895fc7fc589 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:08.245035 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cd69837f-ae92-4ca0-bda1-1895fc7fc589 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:08.245474 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cd69837f-ae92-4ca0-bda1-1895fc7fc589 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:08.250408 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:08.250675 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:08.251858 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-723f3d8c-b279-4b82-89da-7674780d9864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.176183 May 10 03:18:08.252623 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 239/479] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:08 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:08.373411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-cd69837f-ae92-4ca0-bda1-1895fc7fc589 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:08.380738 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-cd69837f-ae92-4ca0-bda1-1895fc7fc589 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.147875 May 10 03:18:08.381329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 241/480] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:08 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:09.090256 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f62302c7-f524-4024-bdbf-b44f78f2ed19 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:09.090866 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f62302c7-f524-4024-bdbf-b44f78f2ed19 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:09.097248 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f62302c7-f524-4024-bdbf-b44f78f2ed19 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.097697 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f62302c7-f524-4024-bdbf-b44f78f2ed19 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.098458 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f62302c7-f524-4024-bdbf-b44f78f2ed19 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.098889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f62302c7-f524-4024-bdbf-b44f78f2ed19 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.134642 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-078191e3-a605-47d4-a6b4-6413edcc445b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:09.135202 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-078191e3-a605-47d4-a6b4-6413edcc445b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:09.141585 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-078191e3-a605-47d4-a6b4-6413edcc445b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.142028 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-078191e3-a605-47d4-a6b4-6413edcc445b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.142807 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-078191e3-a605-47d4-a6b4-6413edcc445b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.143321 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-078191e3-a605-47d4-a6b4-6413edcc445b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.226935 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f62302c7-f524-4024-bdbf-b44f78f2ed19 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:09.235607 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f62302c7-f524-4024-bdbf-b44f78f2ed19 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.149180 May 10 03:18:09.236192 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 240/481] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:09 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:09.240619 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:09.241304 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:09.247658 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.248100 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.248885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.249318 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.274259 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-078191e3-a605-47d4-a6b4-6413edcc445b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:09.279086 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.279530 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.279974 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lazy-loading 'fault' on Instance uuid e867a0c9-e715-4ac3-8be5-1bb4e64f56fb {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:18:09.282113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-078191e3-a605-47d4-a6b4-6413edcc445b tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1513 microversion: 2.1 time: 0.151512 May 10 03:18:09.282681 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 242/482] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:09 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:09.287322 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:09.287927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:09.294008 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.294455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.295224 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.295677 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.325036 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:09.332483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c7b38bad-6c84-46c5-a474-259321830a45 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1332 microversion: 2.1 time: 0.095307 May 10 03:18:09.333175 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 241/483] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:09 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:09.398185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f0d2022a-a075-4638-821f-57681d10b3db tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:09.399034 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f0d2022a-a075-4638-821f-57681d10b3db tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:09.406396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f0d2022a-a075-4638-821f-57681d10b3db tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.406849 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f0d2022a-a075-4638-821f-57681d10b3db tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.407661 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f0d2022a-a075-4638-821f-57681d10b3db tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:09.408096 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f0d2022a-a075-4638-821f-57681d10b3db tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:09.428001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:09.436684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:09.438264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:09.439514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f361dcb3-f218-4c84-931a-d90b19b7bf67 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.155926 May 10 03:18:09.440149 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 243/484] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:09 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:09.536231 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f0d2022a-a075-4638-821f-57681d10b3db tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:09.543506 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f0d2022a-a075-4638-821f-57681d10b3db tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.149565 May 10 03:18:09.544065 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 242/485] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:09 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:10.253394 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-13bd925c-c52c-4721-bad9-b23463a3e377 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:10.254007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-13bd925c-c52c-4721-bad9-b23463a3e377 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:10.260386 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-13bd925c-c52c-4721-bad9-b23463a3e377 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.260871 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-13bd925c-c52c-4721-bad9-b23463a3e377 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.261634 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-13bd925c-c52c-4721-bad9-b23463a3e377 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.262072 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-13bd925c-c52c-4721-bad9-b23463a3e377 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.299026 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-63d2be98-e669-4b4d-a0e0-3c6fbc336424 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:10.299639 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-63d2be98-e669-4b4d-a0e0-3c6fbc336424 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:10.305993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-63d2be98-e669-4b4d-a0e0-3c6fbc336424 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.306449 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-63d2be98-e669-4b4d-a0e0-3c6fbc336424 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.307404 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-63d2be98-e669-4b4d-a0e0-3c6fbc336424 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.307843 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-63d2be98-e669-4b4d-a0e0-3c6fbc336424 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.392098 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-13bd925c-c52c-4721-bad9-b23463a3e377 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:10.400786 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-13bd925c-c52c-4721-bad9-b23463a3e377 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.150660 May 10 03:18:10.401367 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 244/486] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:10 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:10.406069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:10.406680 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:10.412401 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.412881 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.413645 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.414077 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.436799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-63d2be98-e669-4b4d-a0e0-3c6fbc336424 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:10.444155 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-63d2be98-e669-4b4d-a0e0-3c6fbc336424 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1513 microversion: 2.1 time: 0.148840 May 10 03:18:10.444532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.444756 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 243/487] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:10 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:10.445012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.445464 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lazy-loading 'fault' on Instance uuid e867a0c9-e715-4ac3-8be5-1bb4e64f56fb {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:18:10.457967 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:10.458704 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:10.467686 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.467686 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.467686 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.467686 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.486913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:10.495016 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-663f2f14-2906-4297-9d7a-f5581462088b tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 200 len: 1332 microversion: 2.1 time: 0.092569 May 10 03:18:10.495599 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 245/488] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:10 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:10.561074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6ed567ed-ca05-45e0-9e8d-e9e32e27c5c8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:10.561804 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6ed567ed-ca05-45e0-9e8d-e9e32e27c5c8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:10.567672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6ed567ed-ca05-45e0-9e8d-e9e32e27c5c8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.568209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6ed567ed-ca05-45e0-9e8d-e9e32e27c5c8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.569073 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6ed567ed-ca05-45e0-9e8d-e9e32e27c5c8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:10.569511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6ed567ed-ca05-45e0-9e8d-e9e32e27c5c8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:10.596502 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:10.604639 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:10.606577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:10.607750 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a5994074-75c1-4f9f-9e80-0b2f03b8c3a1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.153554 May 10 03:18:10.608311 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 244/489] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:10 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:10.693314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6ed567ed-ca05-45e0-9e8d-e9e32e27c5c8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:10.701071 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6ed567ed-ca05-45e0-9e8d-e9e32e27c5c8 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.144335 May 10 03:18:10.701647 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 246/490] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:10 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:11.419142 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1afc2904-dac8-4970-ad3f-e40cc78cfa09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:11.420140 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1afc2904-dac8-4970-ad3f-e40cc78cfa09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:11.427211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1afc2904-dac8-4970-ad3f-e40cc78cfa09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.427673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1afc2904-dac8-4970-ad3f-e40cc78cfa09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.428461 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1afc2904-dac8-4970-ad3f-e40cc78cfa09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.428919 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1afc2904-dac8-4970-ad3f-e40cc78cfa09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.461022 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9c8dca78-e3c1-4ddd-a419-a8970f209ca6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:11.461641 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9c8dca78-e3c1-4ddd-a419-a8970f209ca6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:11.467954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c8dca78-e3c1-4ddd-a419-a8970f209ca6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.468402 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c8dca78-e3c1-4ddd-a419-a8970f209ca6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.469195 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c8dca78-e3c1-4ddd-a419-a8970f209ca6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.469627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9c8dca78-e3c1-4ddd-a419-a8970f209ca6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.559599 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1afc2904-dac8-4970-ad3f-e40cc78cfa09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:11.567513 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1afc2904-dac8-4970-ad3f-e40cc78cfa09 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.153044 May 10 03:18:11.568098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 245/491] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:11 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:11.573318 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:11.573923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:11.579595 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.580042 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.580837 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.581271 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.595250 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb HTTP/1.1 May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:18:11.596923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:18:11.598269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': 'e867a0c9-e715-4ac3-8be5-1bb4e64f56fb'} May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:18:11.598998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:18:11.600300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:11.601515 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:18:11.601515 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fb0e7a52-05d9-4df4-bce7-bc785adefb6f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 404 len: 111 microversion: 2.1 time: 0.029292 May 10 03:18:11.601515 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 246/492] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:11 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:18:11.603662 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9c8dca78-e3c1-4ddd-a419-a8970f209ca6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:11.607177 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-42bb1da9-022a-47c0-bf3b-441184851ceb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '.version_select at 0x7f14a4730700>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:11.611081 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9c8dca78-e3c1-4ddd-a419-a8970f209ca6 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1513 microversion: 2.1 time: 0.153834 May 10 03:18:11.611643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 247/493] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:11 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:11.625396 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:11.625631 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-42bb1da9-022a-47c0-bf3b-441184851ceb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094492101" status: 202 len: 0 microversion: 2.1 time: 0.022214 May 10 03:18:11.626001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:11.626192 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 247/494] 10.222.0.55 () {58 vars in 1220 bytes} [Tue May 10 03:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094492101 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:18:11.631856 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.632306 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.633102 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.633664 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.719268 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b5b2b328-4182-4661-b58d-49b94f0bdda0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:11.720034 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b5b2b328-4182-4661-b58d-49b94f0bdda0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:11.727047 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b5b2b328-4182-4661-b58d-49b94f0bdda0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.727523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b5b2b328-4182-4661-b58d-49b94f0bdda0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.729236 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b5b2b328-4182-4661-b58d-49b94f0bdda0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.729236 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b5b2b328-4182-4661-b58d-49b94f0bdda0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.880770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b5b2b328-4182-4661-b58d-49b94f0bdda0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:11.888975 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b5b2b328-4182-4661-b58d-49b94f0bdda0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.173140 May 10 03:18:11.898416 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 248/495] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:11 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:11.961314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:11.969928 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:11.971627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:11.972825 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ef93c928-217e-4c92-8ef3-65ee1384de35 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1724 microversion: 2.20 time: 0.351134 May 10 03:18:11.973578 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 248/496] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:11 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:12.369283 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-70ef062b-4f58-4526-9e4a-2cd4be420e00 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: .version_select at 0x7f14a52ce160>, body: {"keypair": {"name": "tempest-keypair-1563066053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuIf/ypkWomA3ZoydNE9tRtebxN7KqNaObBckoAMqKmL1J6ytkxJ7mQ9IGUF2ku5a1iKUP6W+Z/8QCVcRIxYw9SWVbEoei2pWFoF2sbco0Ajwkbiq5vb/v9b5IPkS1VLA=="}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:12.382847 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-70ef062b-4f58-4526-9e4a-2cd4be420e00 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:18:12.387253 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-70ef062b-4f58-4526-9e4a-2cd4be420e00 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for user 775d3d61ab8d42c3a528028592ad71f8 and project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:18:12.410498 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-70ef062b-4f58-4526-9e4a-2cd4be420e00 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044671 May 10 03:18:12.416212 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 249/497] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:18:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:12.473715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-c698723e-559d-41c1-98c6-681999c23de5 req-6a3dc0ad-2708-4be9-be20-3ac388b6a473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f8dd94-00ab-409a-82f3-734c6bc9e294", "name": "network-vif-deleted", "tag": "0854563f-6713-4e37-8fa0-66d7c2d1331f"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:12.487352 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-c698723e-559d-41c1-98c6-681999c23de5 req-6a3dc0ad-2708-4be9-be20-3ac388b6a473 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:12.488147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-c698723e-559d-41c1-98c6-681999c23de5 req-6a3dc0ad-2708-4be9-be20-3ac388b6a473 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:12.503617 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-c698723e-559d-41c1-98c6-681999c23de5 req-6a3dc0ad-2708-4be9-be20-3ac388b6a473 service nova] Creating event network-vif-deleted:0854563f-6713-4e37-8fa0-66d7c2d1331f for instance 87f8dd94-00ab-409a-82f3-734c6bc9e294 on hv-cinder-83009 May 10 03:18:12.512015 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-c698723e-559d-41c1-98c6-681999c23de5 req-6a3dc0ad-2708-4be9-be20-3ac388b6a473 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044853 May 10 03:18:12.512979 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 249/498] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:12.588147 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f4b7701a-c976-4136-92cc-5a0d269e4c50 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:12.588783 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f4b7701a-c976-4136-92cc-5a0d269e4c50 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:12.598565 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4b7701a-c976-4136-92cc-5a0d269e4c50 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:12.599018 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4b7701a-c976-4136-92cc-5a0d269e4c50 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:12.599841 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4b7701a-c976-4136-92cc-5a0d269e4c50 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:12.600433 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4b7701a-c976-4136-92cc-5a0d269e4c50 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:12.631623 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:12.632853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:12.645667 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:12.649536 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:12.651382 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:12.651978 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:12.686745 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:12.687178 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:12.687679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lazy-loading 'fault' on Instance uuid 87f8dd94-00ab-409a-82f3-734c6bc9e294 {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:18:12.760935 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f176581b3794d139a4546d6aef2b959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c623f8bafbe4349a313eef2b75c8154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:12.771508 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9131fe23-7fce-4379-b8c6-4120c57cd53c tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 200 len: 1308 microversion: 2.1 time: 0.145499 May 10 03:18:12.772171 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 250/499] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:12 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:12.820289 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f4b7701a-c976-4136-92cc-5a0d269e4c50 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:12.829248 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f4b7701a-c976-4136-92cc-5a0d269e4c50 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.247314 May 10 03:18:12.830091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 250/500] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:12 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:12.910830 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-bd23481f-27b0-4dc0-941e-0976c2c17944 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:12.911982 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-bd23481f-27b0-4dc0-941e-0976c2c17944 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:12.922315 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bd23481f-27b0-4dc0-941e-0976c2c17944 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:12.923001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bd23481f-27b0-4dc0-941e-0976c2c17944 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:12.923951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bd23481f-27b0-4dc0-941e-0976c2c17944 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:12.924396 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bd23481f-27b0-4dc0-941e-0976c2c17944 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:12.991719 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:12.992476 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:13.000449 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.001184 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.002157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.002580 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.135792 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:13.144533 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:13.146416 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:13.147682 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fec7076f-413e-410b-bd4f-4f01763fac36 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1656 microversion: 2.20 time: 0.160060 May 10 03:18:13.154786 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 251/501] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:12 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1656 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:13.450940 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-bd23481f-27b0-4dc0-941e-0976c2c17944 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:13.460580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-bd23481f-27b0-4dc0-941e-0976c2c17944 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.554591 May 10 03:18:13.461831 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 251/502] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:12 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:13.789598 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:13.791659 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] [instance: 87f8dd94-00ab-409a-82f3-734c6bc9e294] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:13.811105 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.813197 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.816523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.819147 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.842040 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] HTTP exception thrown: Instance 87f8dd94-00ab-409a-82f3-734c6bc9e294 could not be found. May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Request method failure captured: May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 HTTP/1.1 May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedkA4Ev_4Tm-t1Fiq8LvXqRYGh1d1pOhs5WwRCu3OtzgNxCZy7NODRTYgTtAPLdvJ9LoZ4tc1GmBWs6jSQ7NcniProjyiH48fxqZvtc7eBzBMyxMzpIoUGfov8BVrVpSaQPGv_IGdoqsdxFyBITAqpMetZ4fUD2OrmoQVgtXKnYzH2w May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 7c623f8bafbe4349a313eef2b75c8154 May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1239410557 May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:18:13.843371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7c623f8bafbe4349a313eef2b75c8154"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7c623f8bafbe4349a313eef2b75c8154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7c623f8bafbe4349a313eef2b75c8154", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7c623f8bafbe4349a313eef2b75c8154"}]}] May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-VolumesSnapshotTestJSON-1239410557 May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 7c623f8bafbe4349a313eef2b75c8154 May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1239410557 May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-VolumesSnapshotTestJSON-1239410557-project May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 1f176581b3794d139a4546d6aef2b959 May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-VolumesSnapshotTestJSON-1239410557-project May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 87f8dd94-00ab-409a-82f3-734c6bc9e294 could not be found. May 10 03:18:13.845063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '87f8dd94-00ab-409a-82f3-734c6bc9e294'} May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f8dd94-00ab-409a-82f3-734c6bc9e294 could not be found. May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:18:13.845930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f8dd94-00ab-409a-82f3-734c6bc9e294 could not be found. May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f8dd94-00ab-409a-82f3-734c6bc9e294 could not be found. May 10 03:18:13.847443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:13.856104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] Returning 404 to user: Instance 87f8dd94-00ab-409a-82f3-734c6bc9e294 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:18:13.856104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9e587632-76c8-4877-91b6-53f93bf8a663 tempest-VolumesSnapshotTestJSON-1239410557 tempest-VolumesSnapshotTestJSON-1239410557-project] 10.222.0.55 "GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294" status: 404 len: 111 microversion: 2.1 time: 0.059225 May 10 03:18:13.856104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 252/503] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:13 2022] GET /compute/v2.1/servers/87f8dd94-00ab-409a-82f3-734c6bc9e294 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:18:13.856536 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7f188b7c-da27-47dc-bb16-a53e6a7a9a94 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:13.856536 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7f188b7c-da27-47dc-bb16-a53e6a7a9a94 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:13.858751 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7f188b7c-da27-47dc-bb16-a53e6a7a9a94 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.858933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7f188b7c-da27-47dc-bb16-a53e6a7a9a94 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.859727 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7f188b7c-da27-47dc-bb16-a53e6a7a9a94 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.860092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7f188b7c-da27-47dc-bb16-a53e6a7a9a94 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.994515 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-287926912", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20b0c49b-98e0-4d73-bdea-8b46faafc116"}], "security_groups": [{"name": "tempest-securitygroup--733380502"}], "key_name": "tempest-keypair-1563066053", "user_data": "}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:14.036294 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-7f188b7c-da27-47dc-bb16-a53e6a7a9a94 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:14.054481 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7f188b7c-da27-47dc-bb16-a53e6a7a9a94 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.210495 May 10 03:18:14.055268 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 252/504] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:13 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:14.115112 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] validate_networks() for [('20b0c49b-98e0-4d73-bdea-8b46faafc116', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:18:14.168076 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:14.168725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:14.175045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.175971 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.177228 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.177892 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.215760 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.216633 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.217676 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lazy-loading 'fault' on Instance uuid 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:18:14.262260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:14.270949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:14.273755 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:14.275570 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d338f03c-4944-48db-a8a3-c83660f102ef tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 200 len: 1372 microversion: 2.20 time: 0.112395 May 10 03:18:14.276644 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 253/505] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:14 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:14.480281 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-58b5d0f2-ac3c-404b-874c-512d78f5542f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:14.481019 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-58b5d0f2-ac3c-404b-874c-512d78f5542f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:14.487277 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-58b5d0f2-ac3c-404b-874c-512d78f5542f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.487731 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-58b5d0f2-ac3c-404b-874c-512d78f5542f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.488509 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-58b5d0f2-ac3c-404b-874c-512d78f5542f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.488966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-58b5d0f2-ac3c-404b-874c-512d78f5542f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.585255 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:18:14.585679 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:18:14.586150 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:18:14.586554 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:18:14.586964 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:18:14.596553 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.597401 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.598400 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.598835 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.616354 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:18:14.620798 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for user 775d3d61ab8d42c3a528028592ad71f8 and project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:18:14.632255 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:18:14.635150 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:18:14.639285 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-58b5d0f2-ac3c-404b-874c-512d78f5542f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:14.646982 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-58b5d0f2-ac3c-404b-874c-512d78f5542f tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.171475 May 10 03:18:14.647835 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 254/506] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:14 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:14.653193 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-55e64c6c-1472-4184-b2a8-dfac4c7a3996 req-e91eba8f-27c5-41d5-aa0b-d27421790dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f", "name": "network-vif-deleted", "tag": "3ec8beef-b88c-43f8-8d89-f6c589198e59"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:14.661627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-55e64c6c-1472-4184-b2a8-dfac4c7a3996 req-e91eba8f-27c5-41d5-aa0b-d27421790dbe service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.662104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-55e64c6c-1472-4184-b2a8-dfac4c7a3996 req-e91eba8f-27c5-41d5-aa0b-d27421790dbe service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.674489 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-55e64c6c-1472-4184-b2a8-dfac4c7a3996 req-e91eba8f-27c5-41d5-aa0b-d27421790dbe service nova] Creating event network-vif-deleted:3ec8beef-b88c-43f8-8d89-f6c589198e59 for instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f on hv-cinder-83009 May 10 03:18:14.679271 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-55e64c6c-1472-4184-b2a8-dfac4c7a3996 req-e91eba8f-27c5-41d5-aa0b-d27421790dbe service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030429 May 10 03:18:14.683616 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 255/507] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:14.688166 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-648c4e28-0ba5-432d-b5a4-0ecf99c27748 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.698701 May 10 03:18:14.693763 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 253/508] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:18:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:18:14.700273 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-36206db9-72e8-443f-802f-c10074991fd7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:14.701023 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-36206db9-72e8-443f-802f-c10074991fd7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:14.755754 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-36206db9-72e8-443f-802f-c10074991fd7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:14.765327 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-36206db9-72e8-443f-802f-c10074991fd7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1241 microversion: 2.1 time: 0.069261 May 10 03:18:14.766112 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 256/509] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:14 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:15.073316 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1a856ec5-53aa-4603-bef3-1236fa6e5fdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:15.074023 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1a856ec5-53aa-4603-bef3-1236fa6e5fdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:15.080382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1a856ec5-53aa-4603-bef3-1236fa6e5fdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.080871 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1a856ec5-53aa-4603-bef3-1236fa6e5fdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.081641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1a856ec5-53aa-4603-bef3-1236fa6e5fdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.082112 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1a856ec5-53aa-4603-bef3-1236fa6e5fdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.217462 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1a856ec5-53aa-4603-bef3-1236fa6e5fdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:15.225658 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1a856ec5-53aa-4603-bef3-1236fa6e5fdf tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.157019 May 10 03:18:15.226223 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 254/510] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:15 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:15.294619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:15.295225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:15.302408 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.302856 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.303632 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.304065 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.319935 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] HTTP exception thrown: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Request method failure captured: May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f HTTP/1.1 May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediP7oia5fjS4Un7z8iBLReCY8sjD4RVKW9fubFuH9zARx0HDkZplcBvzmD7f-iWAobE7IO2y4KkzXF2Fy8o7HgGMh3DFSovGPdO-rZgKeHCDxSklGi0EEupyEuxzX2cmBYLN2nLEW6UKzlZ_nFyf4uOKxGuLWE_HzIw5Mkna8fow40 May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:18:15.321695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4149fee898c44c180ae1de15ac9d9da", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4149fee898c44c180ae1de15ac9d9da"}]}] May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: a8a3337faba84d0aa85df4121ffb5cd2 May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:18:15.323225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f'} May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:18:15.324069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:18:15.326139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:18:15.327757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Returning 404 to user: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:18:15.327757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-fcc74062-eda1-409d-8d00-28cee366e0a3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 404 len: 111 microversion: 2.20 time: 0.033008 May 10 03:18:15.327757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 257/511] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:15 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:18:15.331887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-08fd2319-1bff-4951-99e1-79399327665a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '.version_select at 0x7f14a5272ca0>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:15.349922 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-08fd2319-1bff-4951-99e1-79399327665a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764817963" status: 204 len: 0 microversion: 2.20 time: 0.021770 May 10 03:18:15.350540 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 255/512] 10.222.0.55 () {60 vars in 1261 bytes} [Tue May 10 03:18:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764817963 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 03:18:15.666221 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-da227911-a973-45ae-9698-bfb08ca780cb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:15.666956 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-da227911-a973-45ae-9698-bfb08ca780cb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:15.673596 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da227911-a973-45ae-9698-bfb08ca780cb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.674115 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da227911-a973-45ae-9698-bfb08ca780cb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.675119 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da227911-a973-45ae-9698-bfb08ca780cb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.675619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da227911-a973-45ae-9698-bfb08ca780cb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.782535 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-31e0a8ce-6939-46c9-ae7a-dacf4ba9a027 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:15.783463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-31e0a8ce-6939-46c9-ae7a-dacf4ba9a027 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:15.790054 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31e0a8ce-6939-46c9-ae7a-dacf4ba9a027 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.791276 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31e0a8ce-6939-46c9-ae7a-dacf4ba9a027 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.792108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31e0a8ce-6939-46c9-ae7a-dacf4ba9a027 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.792610 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31e0a8ce-6939-46c9-ae7a-dacf4ba9a027 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.853874 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-31e0a8ce-6939-46c9-ae7a-dacf4ba9a027 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:15.861458 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-31e0a8ce-6939-46c9-ae7a-dacf4ba9a027 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1299 microversion: 2.1 time: 0.083369 May 10 03:18:15.862135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 256/513] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:15 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:15.940410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-da227911-a973-45ae-9698-bfb08ca780cb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:15.948061 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-da227911-a973-45ae-9698-bfb08ca780cb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.287030 May 10 03:18:15.948672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 258/514] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:15 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:16.148255 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3f7d8f6b-ea1d-4ca2-81ba-63cd022b6bdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'create', calling method: .version_select at 0x7f14a46de040>, body: {"keypair": {"name": "tempest-keypair-907909196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1FVbHneET6YIiqBSiqA2Sp3GxWGNHughIF6EMQaZaqaOKFP7a52+Mv95QtkC3aaK+jRrqcPVuWT3QRjgqT4NvlXDER/7Uo2Xv62GHBRQuxQ5Vc5axfFzqJDaIr1Ny1cQ=="}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:16.162684 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-3f7d8f6b-ea1d-4ca2-81ba-63cd022b6bdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Getting quotas for project f4149fee898c44c180ae1de15ac9d9da. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:18:16.166988 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-3f7d8f6b-ea1d-4ca2-81ba-63cd022b6bdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Getting quotas for user a8a3337faba84d0aa85df4121ffb5cd2 and project f4149fee898c44c180ae1de15ac9d9da. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:18:16.187485 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3f7d8f6b-ea1d-4ca2-81ba-63cd022b6bdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.043171 May 10 03:18:16.188071 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 257/515] 10.222.0.55 () {62 vars in 1199 bytes} [Tue May 10 03:18:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 44 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 03:18:16.243264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-09a576a9-ba33-43f2-b946-5d61a173c5d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:16.244135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-09a576a9-ba33-43f2-b946-5d61a173c5d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:16.250145 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-09a576a9-ba33-43f2-b946-5d61a173c5d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:16.250586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-09a576a9-ba33-43f2-b946-5d61a173c5d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:16.251347 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-09a576a9-ba33-43f2-b946-5d61a173c5d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:16.251776 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-09a576a9-ba33-43f2-b946-5d61a173c5d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:16.412593 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-09a576a9-ba33-43f2-b946-5d61a173c5d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:16.421293 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-09a576a9-ba33-43f2-b946-5d61a173c5d0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.181832 May 10 03:18:16.421872 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 259/516] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:16 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:16.879187 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cc5d14de-0f15-46e2-8dc1-b551b4fd98d5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:16.879739 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-cc5d14de-0f15-46e2-8dc1-b551b4fd98d5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:16.886146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cc5d14de-0f15-46e2-8dc1-b551b4fd98d5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:16.886588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cc5d14de-0f15-46e2-8dc1-b551b4fd98d5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:16.887352 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cc5d14de-0f15-46e2-8dc1-b551b4fd98d5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:16.887778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cc5d14de-0f15-46e2-8dc1-b551b4fd98d5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:16.955303 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-cc5d14de-0f15-46e2-8dc1-b551b4fd98d5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:16.962833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-cc5d14de-0f15-46e2-8dc1-b551b4fd98d5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1299 microversion: 2.1 time: 0.087697 May 10 03:18:16.963572 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 258/517] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:16 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:16.971109 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-96e48744-38d9-451f-89e5-adbecd13ef4d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:16.975313 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-96e48744-38d9-451f-89e5-adbecd13ef4d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:16.978573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96e48744-38d9-451f-89e5-adbecd13ef4d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:16.979103 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96e48744-38d9-451f-89e5-adbecd13ef4d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:16.980132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96e48744-38d9-451f-89e5-adbecd13ef4d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:16.980539 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96e48744-38d9-451f-89e5-adbecd13ef4d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:17.113142 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-96e48744-38d9-451f-89e5-adbecd13ef4d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:17.121560 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-96e48744-38d9-451f-89e5-adbecd13ef4d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.160162 May 10 03:18:17.122586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 260/518] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:16 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:17.438140 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-45ba6efb-423b-47fa-965a-3e8d74f50a56 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:17.438760 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-45ba6efb-423b-47fa-965a-3e8d74f50a56 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:17.445263 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-45ba6efb-423b-47fa-965a-3e8d74f50a56 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:17.445712 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-45ba6efb-423b-47fa-965a-3e8d74f50a56 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:17.446600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-45ba6efb-423b-47fa-965a-3e8d74f50a56 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:17.447131 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-45ba6efb-423b-47fa-965a-3e8d74f50a56 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:17.506556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1556197332", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b607388-5cb4-41a1-8154-ba2917605d5c"}], "security_groups": [{"name": "tempest-securitygroup--1368405114"}], "key_name": "tempest-keypair-907909196", "user_data": "}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:17.582329 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-45ba6efb-423b-47fa-965a-3e8d74f50a56 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:17.590707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-45ba6efb-423b-47fa-965a-3e8d74f50a56 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.156328 May 10 03:18:17.591293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 259/519] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:17 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:17.606976 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.network.neutron [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] validate_networks() for [('2b607388-5cb4-41a1-8154-ba2917605d5c', None, None, None, None, None)] {{(pid=117120) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:18:17.956275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Flavor limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:18:17.956716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Image limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:18:17.957189 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Flavor pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:18:17.957671 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Image pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:18:17.958025 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:18:17.966523 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:17.966963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:17.967752 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:17.968179 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:17.979274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3159c374-5dc7-420e-8397-1ba6ca06cf5c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:17.980020 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3159c374-5dc7-420e-8397-1ba6ca06cf5c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:17.984665 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Getting quotas for project f4149fee898c44c180ae1de15ac9d9da. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:18:17.985917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3159c374-5dc7-420e-8397-1ba6ca06cf5c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:17.986456 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3159c374-5dc7-420e-8397-1ba6ca06cf5c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:17.987291 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3159c374-5dc7-420e-8397-1ba6ca06cf5c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:17.987734 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3159c374-5dc7-420e-8397-1ba6ca06cf5c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:17.988531 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Getting quotas for user a8a3337faba84d0aa85df4121ffb5cd2 and project f4149fee898c44c180ae1de15ac9d9da. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:18:17.999989 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Going to run 1 instances... {{(pid=117120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:18:18.002341 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:18:18.049266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3159c374-5dc7-420e-8397-1ba6ca06cf5c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:18.049848 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e5dd8c7d-afe4-4de2-8ab0-2df12ef4eb0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.547415 May 10 03:18:18.050575 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 261/520] 10.222.0.55 () {62 vars in 1187 bytes} [Tue May 10 03:18:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 03:18:18.059716 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3159c374-5dc7-420e-8397-1ba6ca06cf5c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1299 microversion: 2.1 time: 0.084259 May 10 03:18:18.061318 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f74ce177-919a-494a-9e3b-fac866403066 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:18.061928 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f74ce177-919a-494a-9e3b-fac866403066 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:18.069277 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 260/521] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:17 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:18.118095 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f74ce177-919a-494a-9e3b-fac866403066 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:18.127965 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f74ce177-919a-494a-9e3b-fac866403066 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:18.129752 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f74ce177-919a-494a-9e3b-fac866403066 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:18.131380 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f74ce177-919a-494a-9e3b-fac866403066 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1281 microversion: 2.20 time: 0.074193 May 10 03:18:18.131937 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 262/522] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:18 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:18.145948 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-24625c3d-8420-44ff-ab8e-d22b79a55acf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:18.146572 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-24625c3d-8420-44ff-ab8e-d22b79a55acf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:18.153296 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-24625c3d-8420-44ff-ab8e-d22b79a55acf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:18.153780 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-24625c3d-8420-44ff-ab8e-d22b79a55acf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:18.154517 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-24625c3d-8420-44ff-ab8e-d22b79a55acf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:18.154954 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-24625c3d-8420-44ff-ab8e-d22b79a55acf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:18.316495 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-24625c3d-8420-44ff-ab8e-d22b79a55acf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:18.325846 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-24625c3d-8420-44ff-ab8e-d22b79a55acf tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1675 microversion: 2.1 time: 0.190625 May 10 03:18:18.326497 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 261/523] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:18 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:18.607432 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0d13bd99-3dbe-4824-b4fc-1baa7b681ac6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:18.608329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0d13bd99-3dbe-4824-b4fc-1baa7b681ac6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:18.616088 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0d13bd99-3dbe-4824-b4fc-1baa7b681ac6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:18.616951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0d13bd99-3dbe-4824-b4fc-1baa7b681ac6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:18.618156 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0d13bd99-3dbe-4824-b4fc-1baa7b681ac6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:18.619445 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0d13bd99-3dbe-4824-b4fc-1baa7b681ac6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:18.823046 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0d13bd99-3dbe-4824-b4fc-1baa7b681ac6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:18.831290 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0d13bd99-3dbe-4824-b4fc-1baa7b681ac6 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.227578 May 10 03:18:18.832284 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 263/524] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:18 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:19.077744 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-00596c35-3a5f-49bc-8a76-51ba8c99c197 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:19.078622 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-00596c35-3a5f-49bc-8a76-51ba8c99c197 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:19.086764 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-00596c35-3a5f-49bc-8a76-51ba8c99c197 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.088440 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-00596c35-3a5f-49bc-8a76-51ba8c99c197 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.089906 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-00596c35-3a5f-49bc-8a76-51ba8c99c197 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.091119 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-00596c35-3a5f-49bc-8a76-51ba8c99c197 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.150516 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:19.151930 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:19.160788 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.161532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.162498 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.163088 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.268326 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-00596c35-3a5f-49bc-8a76-51ba8c99c197 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:19.277077 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-00596c35-3a5f-49bc-8a76-51ba8c99c197 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.203376 May 10 03:18:19.277838 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 262/525] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:19 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:19.324013 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:19.334899 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:19.336678 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:19.340472 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1039800c-1852-4d1b-9b8c-edfbe1ab5230 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1341 microversion: 2.20 time: 0.193680 May 10 03:18:19.342160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 264/526] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:19 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:19.345534 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ad83b57b-94f3-4540-9b1e-43fa1b508eb4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:19.346297 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ad83b57b-94f3-4540-9b1e-43fa1b508eb4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:19.356978 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ad83b57b-94f3-4540-9b1e-43fa1b508eb4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.357524 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ad83b57b-94f3-4540-9b1e-43fa1b508eb4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.358319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ad83b57b-94f3-4540-9b1e-43fa1b508eb4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.358867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ad83b57b-94f3-4540-9b1e-43fa1b508eb4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.502698 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ad83b57b-94f3-4540-9b1e-43fa1b508eb4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:19.511294 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ad83b57b-94f3-4540-9b1e-43fa1b508eb4 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1652 microversion: 2.1 time: 0.171235 May 10 03:18:19.511883 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 263/527] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:19 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1652 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:19.528397 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-434d326b-4737-4daa-b11c-c2175979b54b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:19.535398 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-434d326b-4737-4daa-b11c-c2175979b54b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.536120 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-434d326b-4737-4daa-b11c-c2175979b54b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.595899 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-434d326b-4737-4daa-b11c-c2175979b54b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Going to try to start instance {{(pid=117120) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 03:18:19.641329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-434d326b-4737-4daa-b11c-c2175979b54b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/action" status: 202 len: 0 microversion: 2.1 time: 0.116477 May 10 03:18:19.642173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 265/528] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:18:19 2022] POST /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:18:19.650624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d10d85b1-24d1-4e8c-990b-ad721eab6a37 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:19.651247 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d10d85b1-24d1-4e8c-990b-ad721eab6a37 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:19.657432 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d10d85b1-24d1-4e8c-990b-ad721eab6a37 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.657882 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d10d85b1-24d1-4e8c-990b-ad721eab6a37 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.658649 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d10d85b1-24d1-4e8c-990b-ad721eab6a37 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.659182 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d10d85b1-24d1-4e8c-990b-ad721eab6a37 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.816796 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d10d85b1-24d1-4e8c-990b-ad721eab6a37 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:19.827616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d10d85b1-24d1-4e8c-990b-ad721eab6a37 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1661 microversion: 2.1 time: 0.181277 May 10 03:18:19.828212 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 264/529] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:19 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1661 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:19.851530 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-eb68bd9e-31af-4c2f-9fa7-b655ad1e83ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:19.852621 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-eb68bd9e-31af-4c2f-9fa7-b655ad1e83ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:19.860494 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eb68bd9e-31af-4c2f-9fa7-b655ad1e83ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.861068 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eb68bd9e-31af-4c2f-9fa7-b655ad1e83ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.861850 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eb68bd9e-31af-4c2f-9fa7-b655ad1e83ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.862297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eb68bd9e-31af-4c2f-9fa7-b655ad1e83ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:19.986651 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-49857e63-a6a1-4bec-b580-387b7101d823 req-da3ba662-e92f-49b4-bb73-ca559e7a8e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972b595f-8244-44db-a40a-203044d9c20c", "tag": "c3193703-1b47-452e-8101-fee2742e8e7a"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:19.998784 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-49857e63-a6a1-4bec-b580-387b7101d823 req-da3ba662-e92f-49b4-bb73-ca559e7a8e9f service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:19.999430 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-49857e63-a6a1-4bec-b580-387b7101d823 req-da3ba662-e92f-49b4-bb73-ca559e7a8e9f service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:20.018567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-49857e63-a6a1-4bec-b580-387b7101d823 req-da3ba662-e92f-49b4-bb73-ca559e7a8e9f service nova] Creating event network-changed:c3193703-1b47-452e-8101-fee2742e8e7a for instance 972b595f-8244-44db-a40a-203044d9c20c on hv-cinder-83009 May 10 03:18:20.027527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-49857e63-a6a1-4bec-b580-387b7101d823 req-da3ba662-e92f-49b4-bb73-ca559e7a8e9f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052809 May 10 03:18:20.028128 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 265/530] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:20.072132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-eb68bd9e-31af-4c2f-9fa7-b655ad1e83ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:20.080628 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-eb68bd9e-31af-4c2f-9fa7-b655ad1e83ba tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.233391 May 10 03:18:20.081702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 266/531] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:19 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:20.299335 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8e58fa7d-cca0-4c00-b2c4-f37e22ef90fe tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:20.302333 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8e58fa7d-cca0-4c00-b2c4-f37e22ef90fe tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:20.313868 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8e58fa7d-cca0-4c00-b2c4-f37e22ef90fe tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:20.314636 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8e58fa7d-cca0-4c00-b2c4-f37e22ef90fe tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:20.315669 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8e58fa7d-cca0-4c00-b2c4-f37e22ef90fe tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:20.316264 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8e58fa7d-cca0-4c00-b2c4-f37e22ef90fe tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:20.360571 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:20.361163 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:20.369856 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:20.370638 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:20.371546 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:20.372213 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:20.468535 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:20.479906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:20.481922 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:20.483363 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-58b70709-b90b-4fb3-a640-27b93445d3ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1339 microversion: 2.20 time: 0.126900 May 10 03:18:20.484032 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 267/532] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:20 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1339 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:20.564601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8e58fa7d-cca0-4c00-b2c4-f37e22ef90fe tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:20.572605 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8e58fa7d-cca0-4c00-b2c4-f37e22ef90fe tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.277766 May 10 03:18:20.573214 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 266/533] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:20 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:20.846883 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4672b222-28bd-48ae-8a40-546c2e330073 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:20.847671 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4672b222-28bd-48ae-8a40-546c2e330073 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:20.855020 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4672b222-28bd-48ae-8a40-546c2e330073 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:20.855616 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4672b222-28bd-48ae-8a40-546c2e330073 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:20.856506 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4672b222-28bd-48ae-8a40-546c2e330073 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:20.857221 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4672b222-28bd-48ae-8a40-546c2e330073 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:21.097899 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0ddd5129-61b7-4838-8313-faf58b9ad2c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:21.098516 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0ddd5129-61b7-4838-8313-faf58b9ad2c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:21.105435 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0ddd5129-61b7-4838-8313-faf58b9ad2c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:21.105883 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0ddd5129-61b7-4838-8313-faf58b9ad2c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:21.106667 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0ddd5129-61b7-4838-8313-faf58b9ad2c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:21.107099 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0ddd5129-61b7-4838-8313-faf58b9ad2c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:21.318191 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4672b222-28bd-48ae-8a40-546c2e330073 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:21.334318 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4672b222-28bd-48ae-8a40-546c2e330073 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1661 microversion: 2.1 time: 0.490821 May 10 03:18:21.334995 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 268/534] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:20 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1661 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:21.344178 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0ddd5129-61b7-4838-8313-faf58b9ad2c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:21.352840 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0ddd5129-61b7-4838-8313-faf58b9ad2c1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1737 microversion: 2.1 time: 0.258656 May 10 03:18:21.354015 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 267/535] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:21 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:21.503423 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:21.504077 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:21.522715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:21.523441 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:21.525936 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:21.526559 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:21.589730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-19ead2c8-b97f-42d0-a0b3-7a4dbf355c4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:21.590353 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-19ead2c8-b97f-42d0-a0b3-7a4dbf355c4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:21.602060 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19ead2c8-b97f-42d0-a0b3-7a4dbf355c4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:21.602558 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19ead2c8-b97f-42d0-a0b3-7a4dbf355c4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:21.603545 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19ead2c8-b97f-42d0-a0b3-7a4dbf355c4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:21.604142 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19ead2c8-b97f-42d0-a0b3-7a4dbf355c4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:21.686888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:21.695991 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:21.698223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:21.699419 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5476023e-33a2-4712-bd02-f6f5b1971e28 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.200734 May 10 03:18:21.699908 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 269/536] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:21 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:21.746716 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-19ead2c8-b97f-42d0-a0b3-7a4dbf355c4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:21.753998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-19ead2c8-b97f-42d0-a0b3-7a4dbf355c4f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.168447 May 10 03:18:21.754566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 268/537] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:21 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:22.353114 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-99c87a77-5c79-4294-9ed1-41732f36a8ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:22.353881 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-99c87a77-5c79-4294-9ed1-41732f36a8ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:22.360462 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-99c87a77-5c79-4294-9ed1-41732f36a8ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.361028 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-99c87a77-5c79-4294-9ed1-41732f36a8ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.361864 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-99c87a77-5c79-4294-9ed1-41732f36a8ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.362396 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-99c87a77-5c79-4294-9ed1-41732f36a8ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.370183 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fe0f70ff-a948-4812-9eb9-f94cd749b05c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:22.370889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fe0f70ff-a948-4812-9eb9-f94cd749b05c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:22.378474 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fe0f70ff-a948-4812-9eb9-f94cd749b05c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.379211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fe0f70ff-a948-4812-9eb9-f94cd749b05c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.380198 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fe0f70ff-a948-4812-9eb9-f94cd749b05c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.380731 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fe0f70ff-a948-4812-9eb9-f94cd749b05c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.515692 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-fe0f70ff-a948-4812-9eb9-f94cd749b05c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:22.524023 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fe0f70ff-a948-4812-9eb9-f94cd749b05c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1717 microversion: 2.1 time: 0.158130 May 10 03:18:22.525129 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 269/538] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:22 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:22.578809 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-99c87a77-5c79-4294-9ed1-41732f36a8ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:22.591925 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-99c87a77-5c79-4294-9ed1-41732f36a8ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1661 microversion: 2.1 time: 0.242405 May 10 03:18:22.602867 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 270/539] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:22 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1661 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:22.630700 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:22.631318 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:22.639200 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.639951 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.640978 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.641480 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.725113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:22.725497 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:22.741896 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.742050 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] HTTP exception thrown: Cannot 'detach_volume' instance 80b10b34-f1d6-49fe-982c-8d00255bc565 while it is in vm_state rescued May 10 03:18:22.742345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.743199 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.743662 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Request method failure captured: May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: DELETE /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments/21801b4d-6b83-4277-915b-4d67b365a666 HTTP/1.1 May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediXoO1wImN1nMxT7K0VFnyk-ud7eOJBfMgvkNRRRr-cf-c1mcytsGc40j8U9iPKKpvhj7s4rxCFBuOPM9_AXH95peSeHP4-tgZcvutqW8yWliNsFkMABsaym8GaQSqonSfuSW4PejjvkQwy4uAy_wNtzWSflyQWwONBu9NEa0mM9bE May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: d2279255bed8483c82ba27a2451313fc May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:18:22.746205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d2279255bed8483c82ba27a2451313fc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d2279255bed8483c82ba27a2451313fc"}]}] May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: d2279255bed8483c82ba27a2451313fc May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 6dac5d7569d4402ca9c910ea8862b5d9 May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:18:22.747563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Cannot 'detach_volume' instance 80b10b34-f1d6-49fe-982c-8d00255bc565 while it is in vm_state rescued May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'server_id': '80b10b34-f1d6-49fe-982c-8d00255bc565', 'id': '21801b4d-6b83-4277-915b-4d67b365a666'} May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80b10b34-f1d6-49fe-982c-8d00255bc565 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:18:22.748308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 80b10b34-f1d6-49fe-982c-8d00255bc565 while it is in vm_state rescued May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 80b10b34-f1d6-49fe-982c-8d00255bc565 while it is in vm_state rescued May 10 03:18:22.749630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:18:22.750526 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Returning 409 to user: Cannot 'detach_volume' instance 80b10b34-f1d6-49fe-982c-8d00255bc565 while it is in vm_state rescued {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:18:22.753456 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-dcfcf8ec-82bc-4668-ad42-e0fc249684c7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "DELETE /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments/21801b4d-6b83-4277-915b-4d67b365a666" status: 409 len: 152 microversion: 2.1 time: 0.126850 May 10 03:18:22.756025 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 270/540] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:18:22 2022] DELETE /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments/21801b4d-6b83-4277-915b-4d67b365a666 => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 03:18:22.771448 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f17a47d0-fce8-4ad3-876f-6bb7548d01e0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:22.771998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f17a47d0-fce8-4ad3-876f-6bb7548d01e0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:22.780455 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f17a47d0-fce8-4ad3-876f-6bb7548d01e0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.781293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f17a47d0-fce8-4ad3-876f-6bb7548d01e0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.782087 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f17a47d0-fce8-4ad3-876f-6bb7548d01e0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.782533 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f17a47d0-fce8-4ad3-876f-6bb7548d01e0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.856457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f17a47d0-fce8-4ad3-876f-6bb7548d01e0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "POST /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/action" status: 202 len: 0 microversion: 2.1 time: 0.097439 May 10 03:18:22.860352 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 271/541] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:18:22 2022] POST /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:18:22.867107 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-324731e7-0c61-47ad-92d8-b9b13e2d6321 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:22.868049 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-324731e7-0c61-47ad-92d8-b9b13e2d6321 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:22.874718 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-324731e7-0c61-47ad-92d8-b9b13e2d6321 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.875627 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-324731e7-0c61-47ad-92d8-b9b13e2d6321 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.876610 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-324731e7-0c61-47ad-92d8-b9b13e2d6321 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.877270 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-324731e7-0c61-47ad-92d8-b9b13e2d6321 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.971153 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:22.980812 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:22.982530 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:22.983644 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-610e2f52-3bd0-42b6-9667-366db39737dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.269004 May 10 03:18:22.984757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 271/542] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:22 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:22.989647 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a4cd46ab-debe-4dc5-ae1f-37eb405fa0bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:22.990249 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a4cd46ab-debe-4dc5-ae1f-37eb405fa0bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:22.996728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a4cd46ab-debe-4dc5-ae1f-37eb405fa0bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.997181 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a4cd46ab-debe-4dc5-ae1f-37eb405fa0bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:22.997980 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a4cd46ab-debe-4dc5-ae1f-37eb405fa0bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:22.998408 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a4cd46ab-debe-4dc5-ae1f-37eb405fa0bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:23.035452 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-324731e7-0c61-47ad-92d8-b9b13e2d6321 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:23.042985 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-324731e7-0c61-47ad-92d8-b9b13e2d6321 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.180820 May 10 03:18:23.043848 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 272/543] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:22 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:23.112043 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-267fc136-bcaa-4756-bf1b-ae1742d0c50f req-347c50f9-f60b-4441-87a3-0e9636446d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab", "tag": "8849e2ad-b7bd-40d0-aba9-d512831c8b63"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:23.122979 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-267fc136-bcaa-4756-bf1b-ae1742d0c50f req-347c50f9-f60b-4441-87a3-0e9636446d53 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:23.123738 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-267fc136-bcaa-4756-bf1b-ae1742d0c50f req-347c50f9-f60b-4441-87a3-0e9636446d53 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:23.136309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-267fc136-bcaa-4756-bf1b-ae1742d0c50f req-347c50f9-f60b-4441-87a3-0e9636446d53 service nova] Creating event network-changed:8849e2ad-b7bd-40d0-aba9-d512831c8b63 for instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab on hv-cinder-83009 May 10 03:18:23.141686 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-267fc136-bcaa-4756-bf1b-ae1742d0c50f req-347c50f9-f60b-4441-87a3-0e9636446d53 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033349 May 10 03:18:23.143610 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 273/544] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:23.194313 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a4cd46ab-debe-4dc5-ae1f-37eb405fa0bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:23.203265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a4cd46ab-debe-4dc5-ae1f-37eb405fa0bd tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1725 microversion: 2.1 time: 0.217058 May 10 03:18:23.203846 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 272/545] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:22 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:23.610166 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7a998121-13f8-4b74-9470-7f1d9c95068a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:23.610801 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7a998121-13f8-4b74-9470-7f1d9c95068a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:23.617280 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a998121-13f8-4b74-9470-7f1d9c95068a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:23.617730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a998121-13f8-4b74-9470-7f1d9c95068a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:23.619258 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a998121-13f8-4b74-9470-7f1d9c95068a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:23.619691 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7a998121-13f8-4b74-9470-7f1d9c95068a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:23.747613 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7a998121-13f8-4b74-9470-7f1d9c95068a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:23.755059 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7a998121-13f8-4b74-9470-7f1d9c95068a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1665 microversion: 2.1 time: 0.149127 May 10 03:18:23.755628 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 274/546] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:23 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:24.002486 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:24.003096 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:24.009915 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:24.010365 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:24.011124 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:24.011557 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:24.059339 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-34c86f04-60f6-46c1-85b7-e3a33b6d60cb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:24.060068 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-34c86f04-60f6-46c1-85b7-e3a33b6d60cb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:24.066021 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-34c86f04-60f6-46c1-85b7-e3a33b6d60cb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:24.066532 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-34c86f04-60f6-46c1-85b7-e3a33b6d60cb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:24.067385 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-34c86f04-60f6-46c1-85b7-e3a33b6d60cb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:24.067881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-34c86f04-60f6-46c1-85b7-e3a33b6d60cb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:24.142210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:24.150633 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:24.152131 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:24.153261 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-cb2b8d61-841e-45d7-b54b-9d8956fe9297 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.154747 May 10 03:18:24.153808 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 273/547] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:23 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:24.195115 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-34c86f04-60f6-46c1-85b7-e3a33b6d60cb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:24.203147 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-34c86f04-60f6-46c1-85b7-e3a33b6d60cb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.147796 May 10 03:18:24.203706 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 275/548] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:24 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:24.221303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-660195ff-2df3-4294-a165-a91da7790fd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:24.221907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-660195ff-2df3-4294-a165-a91da7790fd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:24.228464 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-660195ff-2df3-4294-a165-a91da7790fd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:24.228944 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-660195ff-2df3-4294-a165-a91da7790fd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:24.229703 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-660195ff-2df3-4294-a165-a91da7790fd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:24.230132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-660195ff-2df3-4294-a165-a91da7790fd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:24.354806 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-660195ff-2df3-4294-a165-a91da7790fd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:24.362664 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-660195ff-2df3-4294-a165-a91da7790fd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1725 microversion: 2.1 time: 0.145131 May 10 03:18:24.363228 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 274/549] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:24 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:25.171723 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:25.172332 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:25.178708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:25.179154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:25.179917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:25.180349 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:25.220333 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0c8d8f61-ee7a-4fa1-8eff-64282465e8e5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:25.220963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0c8d8f61-ee7a-4fa1-8eff-64282465e8e5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:25.228280 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0c8d8f61-ee7a-4fa1-8eff-64282465e8e5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:25.228844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0c8d8f61-ee7a-4fa1-8eff-64282465e8e5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:25.229615 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0c8d8f61-ee7a-4fa1-8eff-64282465e8e5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:25.230045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0c8d8f61-ee7a-4fa1-8eff-64282465e8e5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:25.314578 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:25.323004 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:25.324629 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:25.325760 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-42c7e32c-cfec-4254-bd68-eca522d156ce tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.157924 May 10 03:18:25.326325 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 276/550] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:25 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:25.359406 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0c8d8f61-ee7a-4fa1-8eff-64282465e8e5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:25.366797 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0c8d8f61-ee7a-4fa1-8eff-64282465e8e5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.150252 May 10 03:18:25.367369 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 275/551] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:25 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:25.381692 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4c1dd379-f2f8-4d12-85ff-73e1c66a967e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:25.382295 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4c1dd379-f2f8-4d12-85ff-73e1c66a967e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:25.388324 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4c1dd379-f2f8-4d12-85ff-73e1c66a967e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:25.388821 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4c1dd379-f2f8-4d12-85ff-73e1c66a967e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:25.389576 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4c1dd379-f2f8-4d12-85ff-73e1c66a967e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:25.390006 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4c1dd379-f2f8-4d12-85ff-73e1c66a967e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:25.520401 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4c1dd379-f2f8-4d12-85ff-73e1c66a967e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:25.528902 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4c1dd379-f2f8-4d12-85ff-73e1c66a967e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1725 microversion: 2.1 time: 0.150970 May 10 03:18:25.529471 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 277/552] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:25 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:26.344064 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:26.344587 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:26.350991 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:26.351443 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:26.352238 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:26.352749 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:26.383281 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4ffa9ef8-9810-4e79-ab94-9997398e92df tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:26.384777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4ffa9ef8-9810-4e79-ab94-9997398e92df tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:26.391164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4ffa9ef8-9810-4e79-ab94-9997398e92df tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:26.391607 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4ffa9ef8-9810-4e79-ab94-9997398e92df tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:26.392564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4ffa9ef8-9810-4e79-ab94-9997398e92df tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:26.393034 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4ffa9ef8-9810-4e79-ab94-9997398e92df tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:26.536803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4ffa9ef8-9810-4e79-ab94-9997398e92df tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:26.544672 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4ffa9ef8-9810-4e79-ab94-9997398e92df tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.165122 May 10 03:18:26.545452 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 278/553] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:26 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:26.549853 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8d78f0ea-5244-4c82-a510-fe70e34e0cd1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:26.550459 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8d78f0ea-5244-4c82-a510-fe70e34e0cd1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:26.556541 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d78f0ea-5244-4c82-a510-fe70e34e0cd1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:26.557016 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d78f0ea-5244-4c82-a510-fe70e34e0cd1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:26.557796 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d78f0ea-5244-4c82-a510-fe70e34e0cd1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:26.558234 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d78f0ea-5244-4c82-a510-fe70e34e0cd1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:26.645256 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:26.656872 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:26.659173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:26.660552 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-648369b0-79d6-414b-bd77-876978dde8ca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.320537 May 10 03:18:26.661371 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 276/554] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:26 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:26.694377 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8d78f0ea-5244-4c82-a510-fe70e34e0cd1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:26.702797 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8d78f0ea-5244-4c82-a510-fe70e34e0cd1 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1725 microversion: 2.1 time: 0.156508 May 10 03:18:26.703372 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 279/555] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:26 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:27.561570 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-857488ed-3ca9-4354-afad-a5784ef749db tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:27.562189 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-857488ed-3ca9-4354-afad-a5784ef749db tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:27.568501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-857488ed-3ca9-4354-afad-a5784ef749db tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:27.568981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-857488ed-3ca9-4354-afad-a5784ef749db tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:27.569744 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-857488ed-3ca9-4354-afad-a5784ef749db tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:27.570178 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-857488ed-3ca9-4354-afad-a5784ef749db tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:27.678918 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:27.679530 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:27.686864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:27.687327 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:27.688107 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:27.688549 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:27.700235 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-857488ed-3ca9-4354-afad-a5784ef749db tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:27.707572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-857488ed-3ca9-4354-afad-a5784ef749db tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.149780 May 10 03:18:27.708156 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 277/556] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:27 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:27.719586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-080f3392-b64c-4a75-b51d-6c2bd75734f3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:27.720203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-080f3392-b64c-4a75-b51d-6c2bd75734f3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:27.726190 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-080f3392-b64c-4a75-b51d-6c2bd75734f3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:27.726640 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-080f3392-b64c-4a75-b51d-6c2bd75734f3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:27.728092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-080f3392-b64c-4a75-b51d-6c2bd75734f3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:27.728527 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-080f3392-b64c-4a75-b51d-6c2bd75734f3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:27.818194 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:27.827004 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:27.828611 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:27.829815 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8dbd1605-5f0d-4fed-a4d2-8510df1e8f79 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.154994 May 10 03:18:27.830457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 280/557] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:27 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:27.862198 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-080f3392-b64c-4a75-b51d-6c2bd75734f3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:27.869996 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-080f3392-b64c-4a75-b51d-6c2bd75734f3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1725 microversion: 2.1 time: 0.154213 May 10 03:18:27.870550 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 278/558] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:27 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:28.725030 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-be746c38-0dfb-4129-996b-4560a108a1b7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:28.725644 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-be746c38-0dfb-4129-996b-4560a108a1b7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:28.732584 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-be746c38-0dfb-4129-996b-4560a108a1b7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:28.733072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-be746c38-0dfb-4129-996b-4560a108a1b7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:28.733834 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-be746c38-0dfb-4129-996b-4560a108a1b7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:28.734265 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-be746c38-0dfb-4129-996b-4560a108a1b7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:28.848502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:28.849228 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:28.856077 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:28.856525 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:28.857360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:28.857795 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:28.863168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-be746c38-0dfb-4129-996b-4560a108a1b7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:28.871079 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-be746c38-0dfb-4129-996b-4560a108a1b7 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.149986 May 10 03:18:28.871655 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 281/559] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:28 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:28.886628 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8f261ff2-89c5-48a8-a0a8-8ff7ec6ceea7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:28.887325 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8f261ff2-89c5-48a8-a0a8-8ff7ec6ceea7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:28.893257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8f261ff2-89c5-48a8-a0a8-8ff7ec6ceea7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:28.893781 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8f261ff2-89c5-48a8-a0a8-8ff7ec6ceea7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:28.894643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8f261ff2-89c5-48a8-a0a8-8ff7ec6ceea7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:28.895146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8f261ff2-89c5-48a8-a0a8-8ff7ec6ceea7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:28.984668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:28.992576 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:28.994805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:28.996009 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-38089ada-de2a-4880-bf8a-6683d70f1e4e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.151464 May 10 03:18:28.996685 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 279/560] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:28 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:29.021878 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8f261ff2-89c5-48a8-a0a8-8ff7ec6ceea7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:29.030314 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8f261ff2-89c5-48a8-a0a8-8ff7ec6ceea7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1725 microversion: 2.1 time: 0.147399 May 10 03:18:29.031160 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 282/561] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:28 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:29.887878 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8d644d12-f694-4ca9-83ef-4536f8f7b6ee tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:29.888492 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8d644d12-f694-4ca9-83ef-4536f8f7b6ee tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:29.895059 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8d644d12-f694-4ca9-83ef-4536f8f7b6ee tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:29.895505 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8d644d12-f694-4ca9-83ef-4536f8f7b6ee tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:29.896271 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8d644d12-f694-4ca9-83ef-4536f8f7b6ee tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:29.896725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8d644d12-f694-4ca9-83ef-4536f8f7b6ee tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:30.013963 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:30.014568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:30.020973 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:30.021456 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:30.022263 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:30.022718 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:30.028475 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8d644d12-f694-4ca9-83ef-4536f8f7b6ee tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:30.035905 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8d644d12-f694-4ca9-83ef-4536f8f7b6ee tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.152422 May 10 03:18:30.036690 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 280/562] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:29 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:30.047196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-22ac9413-336e-4477-8b3b-fa04788d390d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:30.047845 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-22ac9413-336e-4477-8b3b-fa04788d390d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:30.054005 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-22ac9413-336e-4477-8b3b-fa04788d390d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:30.054457 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-22ac9413-336e-4477-8b3b-fa04788d390d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:30.055242 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-22ac9413-336e-4477-8b3b-fa04788d390d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:30.056612 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-22ac9413-336e-4477-8b3b-fa04788d390d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:30.168863 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:30.177961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:30.179471 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:30.180593 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e2d0361f-a200-4951-bc15-51f14121a0dc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.170626 May 10 03:18:30.181724 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 283/563] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:30 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:30.198113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-22ac9413-336e-4477-8b3b-fa04788d390d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:30.205978 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-22ac9413-336e-4477-8b3b-fa04788d390d tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1731 microversion: 2.1 time: 0.162693 May 10 03:18:30.206553 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 281/564] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:30 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:30.222225 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2fee0a0c-f529-4b49-9ce1-f73cb73d9605 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:30.222717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2fee0a0c-f529-4b49-9ce1-f73cb73d9605 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:30.229102 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fee0a0c-f529-4b49-9ce1-f73cb73d9605 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:30.229553 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fee0a0c-f529-4b49-9ce1-f73cb73d9605 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:30.230324 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fee0a0c-f529-4b49-9ce1-f73cb73d9605 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:30.230758 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fee0a0c-f529-4b49-9ce1-f73cb73d9605 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:30.310747 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2fee0a0c-f529-4b49-9ce1-f73cb73d9605 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092254 May 10 03:18:30.311498 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 284/565] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 10 03:18:30 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:31.053386 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-060ce25f-aef5-4d18-91e8-8c887dd8aeac tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:31.053972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-060ce25f-aef5-4d18-91e8-8c887dd8aeac tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:31.060514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-060ce25f-aef5-4d18-91e8-8c887dd8aeac tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:31.061243 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-060ce25f-aef5-4d18-91e8-8c887dd8aeac tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:31.062020 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-060ce25f-aef5-4d18-91e8-8c887dd8aeac tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:31.062827 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-060ce25f-aef5-4d18-91e8-8c887dd8aeac tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:31.195767 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-060ce25f-aef5-4d18-91e8-8c887dd8aeac tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:31.201544 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:31.203984 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-060ce25f-aef5-4d18-91e8-8c887dd8aeac tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.154375 May 10 03:18:31.204944 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 282/566] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:31 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:31.209494 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:31.221942 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:31.222390 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:31.223168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:31.223599 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:31.234046 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-36099c29-b16a-42b0-875e-925aeba6211d req-ee12352a-cc9d-4a1f-a449-5dd4d9429b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b10b34-f1d6-49fe-982c-8d00255bc565", "tag": "7b55a664-e823-4d00-8935-550519d0fdf6"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:31.242356 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-36099c29-b16a-42b0-875e-925aeba6211d req-ee12352a-cc9d-4a1f-a449-5dd4d9429b85 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:31.243539 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-36099c29-b16a-42b0-875e-925aeba6211d req-ee12352a-cc9d-4a1f-a449-5dd4d9429b85 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:31.254523 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-36099c29-b16a-42b0-875e-925aeba6211d req-ee12352a-cc9d-4a1f-a449-5dd4d9429b85 service nova] Creating event network-changed:7b55a664-e823-4d00-8935-550519d0fdf6 for instance 80b10b34-f1d6-49fe-982c-8d00255bc565 on hv-cinder-83009 May 10 03:18:31.260483 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-36099c29-b16a-42b0-875e-925aeba6211d req-ee12352a-cc9d-4a1f-a449-5dd4d9429b85 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029787 May 10 03:18:31.261132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 283/567] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:31.367521 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:31.375573 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:31.377119 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:31.378230 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-579364e8-7526-4093-8696-2e9421c2d3ec tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.183561 May 10 03:18:31.378790 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 285/568] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:31 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:32.080329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-3a5703f2-aa1d-4387-a3f8-a948b92ad9bf req-c717fc8b-262b-478b-a84e-86c66026ff9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972b595f-8244-44db-a40a-203044d9c20c", "name": "network-vif-plugged", "status": "completed", "tag": "c3193703-1b47-452e-8101-fee2742e8e7a"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:32.097777 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-3a5703f2-aa1d-4387-a3f8-a948b92ad9bf req-c717fc8b-262b-478b-a84e-86c66026ff9b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:32.098545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-3a5703f2-aa1d-4387-a3f8-a948b92ad9bf req-c717fc8b-262b-478b-a84e-86c66026ff9b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:32.111754 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-3a5703f2-aa1d-4387-a3f8-a948b92ad9bf req-c717fc8b-262b-478b-a84e-86c66026ff9b service nova] Creating event network-vif-plugged:c3193703-1b47-452e-8101-fee2742e8e7a for instance 972b595f-8244-44db-a40a-203044d9c20c on hv-cinder-83009 May 10 03:18:32.119096 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-3a5703f2-aa1d-4387-a3f8-a948b92ad9bf req-c717fc8b-262b-478b-a84e-86c66026ff9b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054682 May 10 03:18:32.120286 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 284/569] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:32.221519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d24ad88f-f2f1-4d70-9e32-c368553082c8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:32.222723 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d24ad88f-f2f1-4d70-9e32-c368553082c8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:32.230604 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d24ad88f-f2f1-4d70-9e32-c368553082c8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:32.231305 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d24ad88f-f2f1-4d70-9e32-c368553082c8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:32.232464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d24ad88f-f2f1-4d70-9e32-c368553082c8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:32.233063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d24ad88f-f2f1-4d70-9e32-c368553082c8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:32.385637 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d24ad88f-f2f1-4d70-9e32-c368553082c8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:32.393975 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d24ad88f-f2f1-4d70-9e32-c368553082c8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.176050 May 10 03:18:32.394963 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 286/570] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:32 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:32.400752 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:32.401474 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:32.407817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:32.408257 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:32.409210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:32.409637 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:32.540305 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:32.547978 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:32.549502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:32.550590 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a4abc84d-79e8-4674-9c6c-f8636af32f1a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.158836 May 10 03:18:32.551140 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 285/571] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:32 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:33.282896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-4dd828b6-38f1-440d-a99c-c088126da4b4 req-4219dabe-2d39-454c-8724-c50768740a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b10b34-f1d6-49fe-982c-8d00255bc565", "tag": "7b55a664-e823-4d00-8935-550519d0fdf6"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:33.292018 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-4dd828b6-38f1-440d-a99c-c088126da4b4 req-4219dabe-2d39-454c-8724-c50768740a8e service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:33.292405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-4dd828b6-38f1-440d-a99c-c088126da4b4 req-4219dabe-2d39-454c-8724-c50768740a8e service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:33.303409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-4dd828b6-38f1-440d-a99c-c088126da4b4 req-4219dabe-2d39-454c-8724-c50768740a8e service nova] Creating event network-changed:7b55a664-e823-4d00-8935-550519d0fdf6 for instance 80b10b34-f1d6-49fe-982c-8d00255bc565 on hv-cinder-83009 May 10 03:18:33.308481 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-4dd828b6-38f1-440d-a99c-c088126da4b4 req-4219dabe-2d39-454c-8724-c50768740a8e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029547 May 10 03:18:33.309094 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 287/572] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:33.411741 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ba77c05d-43dd-4e18-bf64-8cdaec0e4789 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:33.412468 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ba77c05d-43dd-4e18-bf64-8cdaec0e4789 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:33.419265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ba77c05d-43dd-4e18-bf64-8cdaec0e4789 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:33.419789 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ba77c05d-43dd-4e18-bf64-8cdaec0e4789 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:33.420624 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ba77c05d-43dd-4e18-bf64-8cdaec0e4789 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:33.421246 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ba77c05d-43dd-4e18-bf64-8cdaec0e4789 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:33.561267 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ba77c05d-43dd-4e18-bf64-8cdaec0e4789 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:33.567750 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:33.568557 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:33.568824 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ba77c05d-43dd-4e18-bf64-8cdaec0e4789 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1366 microversion: 2.1 time: 0.161135 May 10 03:18:33.569395 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 286/573] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:33 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:33.575708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:33.576156 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:33.576956 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:33.577392 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:33.705730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:33.713541 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:33.715042 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:33.716145 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-853cb751-fbbd-4fd3-b3fa-dfee815417d6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.152645 May 10 03:18:33.716721 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 288/574] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:33 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:34.136766 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-e715dbd7-7208-4245-98ae-8bf8a88160ca req-8145d45a-510d-40ae-86c2-7d85fc501fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab", "name": "network-vif-plugged", "status": "completed", "tag": "8849e2ad-b7bd-40d0-aba9-d512831c8b63"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:34.144763 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-e715dbd7-7208-4245-98ae-8bf8a88160ca req-8145d45a-510d-40ae-86c2-7d85fc501fac service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.145458 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-e715dbd7-7208-4245-98ae-8bf8a88160ca req-8145d45a-510d-40ae-86c2-7d85fc501fac service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.156964 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-e715dbd7-7208-4245-98ae-8bf8a88160ca req-8145d45a-510d-40ae-86c2-7d85fc501fac service nova] Creating event network-vif-plugged:8849e2ad-b7bd-40d0-aba9-d512831c8b63 for instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab on hv-cinder-83009 May 10 03:18:34.161866 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-e715dbd7-7208-4245-98ae-8bf8a88160ca req-8145d45a-510d-40ae-86c2-7d85fc501fac service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029256 May 10 03:18:34.162495 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 287/575] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:34.586176 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0b6d5f4a-3994-4696-b955-f14f8a06000d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:34.587871 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0b6d5f4a-3994-4696-b955-f14f8a06000d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:34.594227 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0b6d5f4a-3994-4696-b955-f14f8a06000d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.594679 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0b6d5f4a-3994-4696-b955-f14f8a06000d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.595477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0b6d5f4a-3994-4696-b955-f14f8a06000d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.595945 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0b6d5f4a-3994-4696-b955-f14f8a06000d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.725963 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0b6d5f4a-3994-4696-b955-f14f8a06000d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:34.733429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0b6d5f4a-3994-4696-b955-f14f8a06000d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1554 microversion: 2.1 time: 0.151121 May 10 03:18:34.734001 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 289/576] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:34 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:34.734258 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:34.734954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:34.740921 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.741376 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.742135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.742575 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.749187 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ec839b1b-12c9-485d-bd3e-bb5db39b47c3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:34.749670 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ec839b1b-12c9-485d-bd3e-bb5db39b47c3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:34.755308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec839b1b-12c9-485d-bd3e-bb5db39b47c3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.755750 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec839b1b-12c9-485d-bd3e-bb5db39b47c3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.756502 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec839b1b-12c9-485d-bd3e-bb5db39b47c3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.756960 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec839b1b-12c9-485d-bd3e-bb5db39b47c3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.832809 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ec839b1b-12c9-485d-bd3e-bb5db39b47c3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087176 May 10 03:18:34.833415 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 290/577] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 10 03:18:34 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:34.872869 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:34.880790 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:34.882314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:34.883630 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-da4b9b60-29a7-40a6-b64a-25605c021c4b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.153825 May 10 03:18:34.884239 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 288/578] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:34 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:18:35.902977 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:35.903591 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:35.909804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:35.910194 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:35.910967 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:35.911427 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:36.088183 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-9f73bc09-c30b-400e-bf40-75f2c6e995ad req-9b25df2d-dc3b-4c08-95df-9c73304cbca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972b595f-8244-44db-a40a-203044d9c20c", "tag": "c3193703-1b47-452e-8101-fee2742e8e7a"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:36.100820 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-9f73bc09-c30b-400e-bf40-75f2c6e995ad req-9b25df2d-dc3b-4c08-95df-9c73304cbca5 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:36.101267 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-9f73bc09-c30b-400e-bf40-75f2c6e995ad req-9b25df2d-dc3b-4c08-95df-9c73304cbca5 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:36.113671 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-9f73bc09-c30b-400e-bf40-75f2c6e995ad req-9b25df2d-dc3b-4c08-95df-9c73304cbca5 service nova] Creating event network-changed:c3193703-1b47-452e-8101-fee2742e8e7a for instance 972b595f-8244-44db-a40a-203044d9c20c on hv-cinder-83009 May 10 03:18:36.119285 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-9f73bc09-c30b-400e-bf40-75f2c6e995ad req-9b25df2d-dc3b-4c08-95df-9c73304cbca5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036104 May 10 03:18:36.119898 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 289/579] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:36.138229 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:36.146267 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:36.147772 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:36.149648 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a8c472d3-e675-4d40-8833-e54fb4bcce7b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1407 microversion: 2.20 time: 0.251092 May 10 03:18:36.150446 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 291/580] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:35 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:37.171229 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:37.171941 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:37.178223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:37.178672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:37.179696 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:37.180171 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:37.325676 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:37.334618 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:37.337360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:37.338656 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-62ca4c80-f375-4f49-a998-832cb9eddfdf tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1598 microversion: 2.20 time: 0.175049 May 10 03:18:37.339334 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 290/581] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:18:37 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:37.357142 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f11c47af-c57a-48ec-8d86-88bac81abbaa tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:37.357776 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f11c47af-c57a-48ec-8d86-88bac81abbaa tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:37.364185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f11c47af-c57a-48ec-8d86-88bac81abbaa tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:37.364645 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f11c47af-c57a-48ec-8d86-88bac81abbaa tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:37.365538 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f11c47af-c57a-48ec-8d86-88bac81abbaa tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:37.366226 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f11c47af-c57a-48ec-8d86-88bac81abbaa tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:37.447041 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f11c47af-c57a-48ec-8d86-88bac81abbaa tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093855 May 10 03:18:37.447886 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 292/582] 10.222.0.55 () {60 vars in 1315 bytes} [Tue May 10 03:18:37 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:18:38.472234 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-1c0de7df-2cc2-4419-bfda-a507e1e84bb0 req-265dc5c4-b24a-41b7-bfd6-c63b965fdf39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab", "tag": "8849e2ad-b7bd-40d0-aba9-d512831c8b63"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:38.482894 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-1c0de7df-2cc2-4419-bfda-a507e1e84bb0 req-265dc5c4-b24a-41b7-bfd6-c63b965fdf39 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:38.483485 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-1c0de7df-2cc2-4419-bfda-a507e1e84bb0 req-265dc5c4-b24a-41b7-bfd6-c63b965fdf39 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:38.495128 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-1c0de7df-2cc2-4419-bfda-a507e1e84bb0 req-265dc5c4-b24a-41b7-bfd6-c63b965fdf39 service nova] Creating event network-changed:8849e2ad-b7bd-40d0-aba9-d512831c8b63 for instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab on hv-cinder-83009 May 10 03:18:38.500372 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-1c0de7df-2cc2-4419-bfda-a507e1e84bb0 req-265dc5c4-b24a-41b7-bfd6-c63b965fdf39 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032576 May 10 03:18:38.501442 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 291/583] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:56.558268 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-85906785-3a1e-48f7-ba1f-03b6bb2b37b7 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Action: 'create', calling method: .version_select at 0x7f14a468dee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1398399798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK1TL0qXjRV24C28QCQWrhNWNOUmwUbQkJSrZ1U8DTmmxBamMLhn0y+amhpi3J5sQuGWz/PqnVzJJgvLKtDk3nB/zzh7ZMYZ/mrohs3nMBTVI06ToiyjDFNT20SZIyDvQ=="}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:56.571995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-85906785-3a1e-48f7-ba1f-03b6bb2b37b7 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Getting quotas for project b79f1de979384c108b5ff0427e44e30b. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:18:56.575768 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-85906785-3a1e-48f7-ba1f-03b6bb2b37b7 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Getting quotas for user a18ecdf65b7c42e0aeb44519eaaff743 and project b79f1de979384c108b5ff0427e44e30b. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:18:56.596147 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-85906785-3a1e-48f7-ba1f-03b6bb2b37b7 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043322 May 10 03:18:56.596766 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 293/584] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:18:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:56.644682 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1415847199", "imageRef": "edca6404-d097-4ef2-a5a2-da0d0873a3b0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1398399798", "networks": [{"uuid": "05efa828-1dab-4ffe-a87b-ab104863313d"}]}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:56.693756 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.network.neutron [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] validate_networks() for [('05efa828-1dab-4ffe-a87b-ab104863313d', None, None, None, None, None)] {{(pid=117120) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:18:57.047363 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Flavor limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:18:57.047786 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Image limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:18:57.048259 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Flavor pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:18:57.048677 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Image pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:18:57.049135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:18:57.057996 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:57.058382 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:57.059182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:57.059615 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:57.076198 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Getting quotas for project b79f1de979384c108b5ff0427e44e30b. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:18:57.080081 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Getting quotas for user a18ecdf65b7c42e0aeb44519eaaff743 and project b79f1de979384c108b5ff0427e44e30b. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:18:57.091450 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Going to run 1 instances... {{(pid=117120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:18:57.093753 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edca6404-d097-4ef2-a5a2-da0d0873a3b0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:18:57.139285 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-bfdde80c-d1a0-4ebb-bf9c-fed10be22196 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498749 May 10 03:18:57.139929 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 292/585] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:18:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:18:57.149550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d249c195-53a1-41bf-b4c5-cf79b1087b62 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:57.150161 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d249c195-53a1-41bf-b4c5-cf79b1087b62 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:57.202556 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d249c195-53a1-41bf-b4c5-cf79b1087b62 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:57.210101 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d249c195-53a1-41bf-b4c5-cf79b1087b62 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1259 microversion: 2.1 time: 0.064256 May 10 03:18:57.211003 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 294/586] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:57 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:58.228536 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7cd0ad68-a46d-4558-b59c-12b99d7110db tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:58.230117 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7cd0ad68-a46d-4558-b59c-12b99d7110db tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:58.237388 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7cd0ad68-a46d-4558-b59c-12b99d7110db tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:58.238172 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7cd0ad68-a46d-4558-b59c-12b99d7110db tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:58.239187 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7cd0ad68-a46d-4558-b59c-12b99d7110db tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:58.239834 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7cd0ad68-a46d-4558-b59c-12b99d7110db tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:58.346422 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-7cd0ad68-a46d-4558-b59c-12b99d7110db tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:58.354295 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7cd0ad68-a46d-4558-b59c-12b99d7110db tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1329 microversion: 2.1 time: 0.131620 May 10 03:18:58.355092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 293/587] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:58 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1329 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:59.372369 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5773c536-f13f-4004-a416-f079502f99a2 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:59.373025 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5773c536-f13f-4004-a416-f079502f99a2 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:59.379766 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5773c536-f13f-4004-a416-f079502f99a2 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:59.380287 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5773c536-f13f-4004-a416-f079502f99a2 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:59.381173 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5773c536-f13f-4004-a416-f079502f99a2 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:59.381677 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5773c536-f13f-4004-a416-f079502f99a2 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:59.517639 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5773c536-f13f-4004-a416-f079502f99a2 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:59.525305 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5773c536-f13f-4004-a416-f079502f99a2 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.156784 May 10 03:18:59.525983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 295/588] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:18:59 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:00.544085 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-59571338-113a-4e85-a3f9-a816e1d96945 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:00.544835 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-59571338-113a-4e85-a3f9-a816e1d96945 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:00.551576 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-59571338-113a-4e85-a3f9-a816e1d96945 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:00.552141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-59571338-113a-4e85-a3f9-a816e1d96945 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:00.553027 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-59571338-113a-4e85-a3f9-a816e1d96945 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:00.553555 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-59571338-113a-4e85-a3f9-a816e1d96945 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:00.689954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-59571338-113a-4e85-a3f9-a816e1d96945 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:00.697897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-59571338-113a-4e85-a3f9-a816e1d96945 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.157937 May 10 03:19:00.698479 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 294/589] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:00 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:01.715460 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fb0c8619-e669-40ad-abc3-9b675cdb7a83 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:01.716192 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fb0c8619-e669-40ad-abc3-9b675cdb7a83 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:01.722680 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fb0c8619-e669-40ad-abc3-9b675cdb7a83 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:01.724409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fb0c8619-e669-40ad-abc3-9b675cdb7a83 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:01.725428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fb0c8619-e669-40ad-abc3-9b675cdb7a83 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:01.725876 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fb0c8619-e669-40ad-abc3-9b675cdb7a83 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:01.862423 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-fb0c8619-e669-40ad-abc3-9b675cdb7a83 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:01.870931 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fb0c8619-e669-40ad-abc3-9b675cdb7a83 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.159565 May 10 03:19:01.871733 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 296/590] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:01 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:02.887932 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2315d2e6-17c3-477d-91e9-d639fbcc997a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:02.888527 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2315d2e6-17c3-477d-91e9-d639fbcc997a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:02.896972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2315d2e6-17c3-477d-91e9-d639fbcc997a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:02.898413 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2315d2e6-17c3-477d-91e9-d639fbcc997a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:02.899329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2315d2e6-17c3-477d-91e9-d639fbcc997a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:02.899766 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2315d2e6-17c3-477d-91e9-d639fbcc997a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:03.033520 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2315d2e6-17c3-477d-91e9-d639fbcc997a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:03.040970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2315d2e6-17c3-477d-91e9-d639fbcc997a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.156842 May 10 03:19:03.041737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 295/591] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:02 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:03.878193 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-6f4e17f2-1571-4d7b-a297-08987d855baa tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:03.879392 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-6f4e17f2-1571-4d7b-a297-08987d855baa tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:03.886535 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6f4e17f2-1571-4d7b-a297-08987d855baa tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:03.886989 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6f4e17f2-1571-4d7b-a297-08987d855baa tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:03.887869 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6f4e17f2-1571-4d7b-a297-08987d855baa tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:03.888244 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6f4e17f2-1571-4d7b-a297-08987d855baa tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:03.920267 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-6f4e17f2-1571-4d7b-a297-08987d855baa tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046709 May 10 03:19:03.920873 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 297/592] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:03 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:19:03.980179 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8b867807-eafd-4654-97c6-de7c2abd81ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:03.980767 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8b867807-eafd-4654-97c6-de7c2abd81ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:03.987204 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8b867807-eafd-4654-97c6-de7c2abd81ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:03.987657 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8b867807-eafd-4654-97c6-de7c2abd81ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:03.988425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8b867807-eafd-4654-97c6-de7c2abd81ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:03.988880 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8b867807-eafd-4654-97c6-de7c2abd81ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:04.022837 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8b867807-eafd-4654-97c6-de7c2abd81ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:19:04.059562 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8d802a18-3907-49d1-9a31-e97159a635a0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:04.060212 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8d802a18-3907-49d1-9a31-e97159a635a0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:04.066266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d802a18-3907-49d1-9a31-e97159a635a0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:04.066736 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d802a18-3907-49d1-9a31-e97159a635a0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:04.067623 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d802a18-3907-49d1-9a31-e97159a635a0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:04.068096 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d802a18-3907-49d1-9a31-e97159a635a0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:04.106707 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8b867807-eafd-4654-97c6-de7c2abd81ba tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "DELETE /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 204 len: 0 microversion: 2.1 time: 0.130604 May 10 03:19:04.107470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 296/593] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:19:03 2022] DELETE /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:19:04.121782 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a205ef71-11bf-4c4e-a74b-475150478d9c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:04.122520 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a205ef71-11bf-4c4e-a74b-475150478d9c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:04.128617 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a205ef71-11bf-4c4e-a74b-475150478d9c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:04.129099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a205ef71-11bf-4c4e-a74b-475150478d9c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:04.129912 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a205ef71-11bf-4c4e-a74b-475150478d9c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:04.130365 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a205ef71-11bf-4c4e-a74b-475150478d9c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:04.236786 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8d802a18-3907-49d1-9a31-e97159a635a0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:04.249742 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8d802a18-3907-49d1-9a31-e97159a635a0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.195334 May 10 03:19:04.251098 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 298/594] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:04 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:04.292852 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a205ef71-11bf-4c4e-a74b-475150478d9c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:04.301986 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a205ef71-11bf-4c4e-a74b-475150478d9c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1671 microversion: 2.1 time: 0.187543 May 10 03:19:04.303182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 297/595] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:04 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:05.267890 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d8ab998a-d8ff-451e-b1ce-1fc052888449 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:05.268618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d8ab998a-d8ff-451e-b1ce-1fc052888449 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:05.275793 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d8ab998a-d8ff-451e-b1ce-1fc052888449 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:05.276310 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d8ab998a-d8ff-451e-b1ce-1fc052888449 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:05.277246 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d8ab998a-d8ff-451e-b1ce-1fc052888449 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:05.277821 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d8ab998a-d8ff-451e-b1ce-1fc052888449 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:05.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0a047154-6d6c-439d-bd9b-c4cf80f9e5d1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:05.322307 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0a047154-6d6c-439d-bd9b-c4cf80f9e5d1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:05.328596 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a047154-6d6c-439d-bd9b-c4cf80f9e5d1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:05.329178 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a047154-6d6c-439d-bd9b-c4cf80f9e5d1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:05.330028 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a047154-6d6c-439d-bd9b-c4cf80f9e5d1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:05.330532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0a047154-6d6c-439d-bd9b-c4cf80f9e5d1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:05.430641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d8ab998a-d8ff-451e-b1ce-1fc052888449 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:05.439628 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d8ab998a-d8ff-451e-b1ce-1fc052888449 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.175462 May 10 03:19:05.451355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 299/596] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:05 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:05.473886 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0a047154-6d6c-439d-bd9b-c4cf80f9e5d1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:05.494300 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0a047154-6d6c-439d-bd9b-c4cf80f9e5d1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1671 microversion: 2.1 time: 0.176996 May 10 03:19:05.494905 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 298/597] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:05 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:06.457900 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1cc800c5-4ad2-42ae-bab1-1c1ecb15ca4b tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:06.458864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1cc800c5-4ad2-42ae-bab1-1c1ecb15ca4b tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:06.465245 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1cc800c5-4ad2-42ae-bab1-1c1ecb15ca4b tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:06.465697 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1cc800c5-4ad2-42ae-bab1-1c1ecb15ca4b tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:06.466522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1cc800c5-4ad2-42ae-bab1-1c1ecb15ca4b tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:06.466962 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1cc800c5-4ad2-42ae-bab1-1c1ecb15ca4b tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:06.513062 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8fea43a2-280d-4620-b01f-8a78b80b44df tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:06.513799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8fea43a2-280d-4620-b01f-8a78b80b44df tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:06.520525 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8fea43a2-280d-4620-b01f-8a78b80b44df tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:06.521156 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8fea43a2-280d-4620-b01f-8a78b80b44df tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:06.522187 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8fea43a2-280d-4620-b01f-8a78b80b44df tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:06.522636 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8fea43a2-280d-4620-b01f-8a78b80b44df tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:06.621651 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1cc800c5-4ad2-42ae-bab1-1c1ecb15ca4b tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:06.629496 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1cc800c5-4ad2-42ae-bab1-1c1ecb15ca4b tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.175646 May 10 03:19:06.630709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 300/598] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:06 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:06.859243 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8fea43a2-280d-4620-b01f-8a78b80b44df tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:06.866576 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8fea43a2-280d-4620-b01f-8a78b80b44df tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1671 microversion: 2.1 time: 0.358694 May 10 03:19:06.867336 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 299/599] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:06 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1671 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:07.647109 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-083d9f22-fde0-4de8-a7ce-81c166005605 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:07.647671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-083d9f22-fde0-4de8-a7ce-81c166005605 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:07.654918 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-083d9f22-fde0-4de8-a7ce-81c166005605 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:07.655366 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-083d9f22-fde0-4de8-a7ce-81c166005605 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:07.656382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-083d9f22-fde0-4de8-a7ce-81c166005605 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:07.656853 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-083d9f22-fde0-4de8-a7ce-81c166005605 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:07.783443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-083d9f22-fde0-4de8-a7ce-81c166005605 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:07.790716 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-083d9f22-fde0-4de8-a7ce-81c166005605 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.147564 May 10 03:19:07.791284 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 301/600] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:07 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:07.884074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1709122a-98ca-4a1e-b021-6875fa53eea1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:07.884732 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1709122a-98ca-4a1e-b021-6875fa53eea1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:07.890974 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1709122a-98ca-4a1e-b021-6875fa53eea1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:07.891414 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1709122a-98ca-4a1e-b021-6875fa53eea1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:07.892164 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1709122a-98ca-4a1e-b021-6875fa53eea1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:07.892593 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1709122a-98ca-4a1e-b021-6875fa53eea1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:08.040989 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1709122a-98ca-4a1e-b021-6875fa53eea1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:08.048948 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1709122a-98ca-4a1e-b021-6875fa53eea1 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1671 microversion: 2.1 time: 0.169217 May 10 03:19:08.049537 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 300/601] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:07 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:08.619881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-75873f69-9762-4036-b8bc-5d877f043e70 req-1e0b9686-9a43-42d0-8ed8-d6b005405e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0144796a-ba13-4fb0-b9a6-ce953cbc7b60", "tag": "f02b6a99-10e5-411e-be0e-44e837772e46"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:08.628174 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-75873f69-9762-4036-b8bc-5d877f043e70 req-1e0b9686-9a43-42d0-8ed8-d6b005405e9c service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:08.628623 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-75873f69-9762-4036-b8bc-5d877f043e70 req-1e0b9686-9a43-42d0-8ed8-d6b005405e9c service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:08.642888 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-75873f69-9762-4036-b8bc-5d877f043e70 req-1e0b9686-9a43-42d0-8ed8-d6b005405e9c service nova] Creating event network-changed:f02b6a99-10e5-411e-be0e-44e837772e46 for instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 on hv-cinder-83009 May 10 03:19:08.648027 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-75873f69-9762-4036-b8bc-5d877f043e70 req-1e0b9686-9a43-42d0-8ed8-d6b005405e9c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034518 May 10 03:19:08.649643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 302/602] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:08.807341 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-48c8417b-8bf0-4472-8d84-d95f61d65c14 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:08.807954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-48c8417b-8bf0-4472-8d84-d95f61d65c14 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:08.813988 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48c8417b-8bf0-4472-8d84-d95f61d65c14 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:08.814440 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48c8417b-8bf0-4472-8d84-d95f61d65c14 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:08.815207 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48c8417b-8bf0-4472-8d84-d95f61d65c14 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:08.815648 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48c8417b-8bf0-4472-8d84-d95f61d65c14 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:08.939410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48c8417b-8bf0-4472-8d84-d95f61d65c14 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:08.946690 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-48c8417b-8bf0-4472-8d84-d95f61d65c14 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.143263 May 10 03:19:08.947263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 301/603] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:08 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:09.032678 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7901535b-2406-4c9c-85fa-8e5f88bb5db2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:09.033280 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7901535b-2406-4c9c-85fa-8e5f88bb5db2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:09.039899 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7901535b-2406-4c9c-85fa-8e5f88bb5db2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.040354 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7901535b-2406-4c9c-85fa-8e5f88bb5db2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:09.041158 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7901535b-2406-4c9c-85fa-8e5f88bb5db2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.041601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7901535b-2406-4c9c-85fa-8e5f88bb5db2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:09.066722 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2aa61eb1-d1d4-493e-b986-f4fba1f78a8c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:09.067332 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2aa61eb1-d1d4-493e-b986-f4fba1f78a8c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:09.073752 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2aa61eb1-d1d4-493e-b986-f4fba1f78a8c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.074204 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2aa61eb1-d1d4-493e-b986-f4fba1f78a8c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:09.074974 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2aa61eb1-d1d4-493e-b986-f4fba1f78a8c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.075408 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2aa61eb1-d1d4-493e-b986-f4fba1f78a8c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:09.120237 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-7901535b-2406-4c9c-85fa-8e5f88bb5db2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lazy-loading 'services' on Instance uuid 80b10b34-f1d6-49fe-982c-8d00255bc565 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:09.193255 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7901535b-2406-4c9c-85fa-8e5f88bb5db2 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "DELETE /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments/21801b4d-6b83-4277-915b-4d67b365a666" status: 202 len: 0 microversion: 2.1 time: 0.165416 May 10 03:19:09.193853 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 303/604] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:19:09 2022] DELETE /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments/21801b4d-6b83-4277-915b-4d67b365a666 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:19:09.203052 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ccbdee67-3ccd-496a-9164-4677686b8454 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:09.204063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ccbdee67-3ccd-496a-9164-4677686b8454 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:09.209091 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2aa61eb1-d1d4-493e-b986-f4fba1f78a8c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:09.210389 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ccbdee67-3ccd-496a-9164-4677686b8454 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.211453 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ccbdee67-3ccd-496a-9164-4677686b8454 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:09.212987 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ccbdee67-3ccd-496a-9164-4677686b8454 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.213428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ccbdee67-3ccd-496a-9164-4677686b8454 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:09.217260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2aa61eb1-d1d4-493e-b986-f4fba1f78a8c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1671 microversion: 2.1 time: 0.154337 May 10 03:19:09.217837 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 302/605] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:09 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:09.241831 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ccbdee67-3ccd-496a-9164-4677686b8454 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043032 May 10 03:19:09.242665 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 304/606] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:09 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:09.963316 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8aff1406-6395-4087-9f54-8a4e60878d76 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:09.963924 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8aff1406-6395-4087-9f54-8a4e60878d76 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:09.970582 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8aff1406-6395-4087-9f54-8a4e60878d76 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.971026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8aff1406-6395-4087-9f54-8a4e60878d76 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:09.971784 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8aff1406-6395-4087-9f54-8a4e60878d76 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.972212 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8aff1406-6395-4087-9f54-8a4e60878d76 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:10.143293 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8aff1406-6395-4087-9f54-8a4e60878d76 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:10.151596 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8aff1406-6395-4087-9f54-8a4e60878d76 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.192154 May 10 03:19:10.152286 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 303/607] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:09 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:10.234415 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-76b3e031-6630-4d8b-a6c5-058502f8faeb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:10.234951 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-76b3e031-6630-4d8b-a6c5-058502f8faeb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:10.241341 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76b3e031-6630-4d8b-a6c5-058502f8faeb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:10.241795 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76b3e031-6630-4d8b-a6c5-058502f8faeb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:10.242717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76b3e031-6630-4d8b-a6c5-058502f8faeb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:10.243149 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76b3e031-6630-4d8b-a6c5-058502f8faeb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:10.253616 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1a575501-e8a0-496c-af65-f39c14d8394a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:10.254602 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1a575501-e8a0-496c-af65-f39c14d8394a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:10.260739 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1a575501-e8a0-496c-af65-f39c14d8394a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:10.261196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1a575501-e8a0-496c-af65-f39c14d8394a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:10.262014 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1a575501-e8a0-496c-af65-f39c14d8394a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:10.262398 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1a575501-e8a0-496c-af65-f39c14d8394a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:10.292618 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1a575501-e8a0-496c-af65-f39c14d8394a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 May 10 03:19:10.293214 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 304/608] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:10 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:10.427173 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-76b3e031-6630-4d8b-a6c5-058502f8faeb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:10.434671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-76b3e031-6630-4d8b-a6c5-058502f8faeb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1671 microversion: 2.1 time: 0.204340 May 10 03:19:10.435240 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 305/609] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:10 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1671 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:11.168606 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f33e2735-20bc-4058-9029-b719cdfdf20a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:11.169236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f33e2735-20bc-4058-9029-b719cdfdf20a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:11.175447 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f33e2735-20bc-4058-9029-b719cdfdf20a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:11.175891 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f33e2735-20bc-4058-9029-b719cdfdf20a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:11.176667 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f33e2735-20bc-4058-9029-b719cdfdf20a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:11.177105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f33e2735-20bc-4058-9029-b719cdfdf20a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:11.303434 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5e659f86-84ce-42c4-93d5-7a267e330b70 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:11.305131 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5e659f86-84ce-42c4-93d5-7a267e330b70 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:11.311481 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5e659f86-84ce-42c4-93d5-7a267e330b70 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:11.311927 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5e659f86-84ce-42c4-93d5-7a267e330b70 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:11.312711 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5e659f86-84ce-42c4-93d5-7a267e330b70 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:11.313143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5e659f86-84ce-42c4-93d5-7a267e330b70 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:11.344158 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5e659f86-84ce-42c4-93d5-7a267e330b70 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 May 10 03:19:11.344773 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 306/610] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:11 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:11.425713 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f33e2735-20bc-4058-9029-b719cdfdf20a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:11.434295 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f33e2735-20bc-4058-9029-b719cdfdf20a tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.269527 May 10 03:19:11.434870 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 305/611] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:11 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:11.452194 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e3bc99c3-bbfb-4b25-b306-274e1f194dad tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:11.453095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e3bc99c3-bbfb-4b25-b306-274e1f194dad tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:11.459315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e3bc99c3-bbfb-4b25-b306-274e1f194dad tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:11.459769 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e3bc99c3-bbfb-4b25-b306-274e1f194dad tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:11.460544 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e3bc99c3-bbfb-4b25-b306-274e1f194dad tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:11.461429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e3bc99c3-bbfb-4b25-b306-274e1f194dad tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:11.594856 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e3bc99c3-bbfb-4b25-b306-274e1f194dad tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:11.602557 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e3bc99c3-bbfb-4b25-b306-274e1f194dad tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1671 microversion: 2.1 time: 0.154370 May 10 03:19:11.603529 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 307/612] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:11 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:12.356604 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7391dbdd-4bb7-4847-b2c4-da842ffb2f5f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:12.357838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7391dbdd-4bb7-4847-b2c4-da842ffb2f5f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:12.367655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7391dbdd-4bb7-4847-b2c4-da842ffb2f5f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.368233 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7391dbdd-4bb7-4847-b2c4-da842ffb2f5f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.369137 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7391dbdd-4bb7-4847-b2c4-da842ffb2f5f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.369669 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7391dbdd-4bb7-4847-b2c4-da842ffb2f5f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.396222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-9211839b-a9a0-4679-b298-fe2592d446a5 req-ffb5fd84-3593-4a93-b13f-2ed73e184d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03eee221-c04f-48de-b2eb-5e696a377e0f", "name": "network-vif-deleted", "tag": "240b8202-e12a-435e-ba1f-ff9f7b64c768"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:12.402024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7391dbdd-4bb7-4847-b2c4-da842ffb2f5f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050391 May 10 03:19:12.402732 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 306/613] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:12 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:19:12.404785 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-9211839b-a9a0-4679-b298-fe2592d446a5 req-ffb5fd84-3593-4a93-b13f-2ed73e184d7e service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.405322 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-9211839b-a9a0-4679-b298-fe2592d446a5 req-ffb5fd84-3593-4a93-b13f-2ed73e184d7e service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.419499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-9211839b-a9a0-4679-b298-fe2592d446a5 req-ffb5fd84-3593-4a93-b13f-2ed73e184d7e service nova] Creating event network-vif-deleted:240b8202-e12a-435e-ba1f-ff9f7b64c768 for instance 03eee221-c04f-48de-b2eb-5e696a377e0f on hv-cinder-83009 May 10 03:19:12.423829 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-9211839b-a9a0-4679-b298-fe2592d446a5 req-ffb5fd84-3593-4a93-b13f-2ed73e184d7e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031051 May 10 03:19:12.424552 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 308/614] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:12.451628 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-533926a1-21a4-4b87-a701-4f1d42a50567 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:12.452264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-533926a1-21a4-4b87-a701-4f1d42a50567 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:12.458581 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-533926a1-21a4-4b87-a701-4f1d42a50567 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.459219 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-533926a1-21a4-4b87-a701-4f1d42a50567 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.459993 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-533926a1-21a4-4b87-a701-4f1d42a50567 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.460418 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-533926a1-21a4-4b87-a701-4f1d42a50567 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.477451 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-16896c63-f86e-42b8-9aa3-8078ec00ee40 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:12.478027 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-16896c63-f86e-42b8-9aa3-8078ec00ee40 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:12.485997 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-16896c63-f86e-42b8-9aa3-8078ec00ee40 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.486455 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-16896c63-f86e-42b8-9aa3-8078ec00ee40 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.487213 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-16896c63-f86e-42b8-9aa3-8078ec00ee40 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.487639 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-16896c63-f86e-42b8-9aa3-8078ec00ee40 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.514519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-16896c63-f86e-42b8-9aa3-8078ec00ee40 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:19:12.595950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-16896c63-f86e-42b8-9aa3-8078ec00ee40 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "DELETE /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 204 len: 0 microversion: 2.1 time: 0.122329 May 10 03:19:12.596578 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 309/615] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:19:12 2022] DELETE /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:19:12.599698 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-533926a1-21a4-4b87-a701-4f1d42a50567 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:12.605762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8ccdff37-0ad7-4d77-bba7-9b8283d8f8a8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:12.606683 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8ccdff37-0ad7-4d77-bba7-9b8283d8f8a8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:12.608221 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-533926a1-21a4-4b87-a701-4f1d42a50567 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.160318 May 10 03:19:12.609304 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 307/616] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:12 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:12.612791 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8ccdff37-0ad7-4d77-bba7-9b8283d8f8a8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.613237 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8ccdff37-0ad7-4d77-bba7-9b8283d8f8a8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.614011 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8ccdff37-0ad7-4d77-bba7-9b8283d8f8a8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.614446 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8ccdff37-0ad7-4d77-bba7-9b8283d8f8a8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.619920 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-67d7fe00-5472-422c-86ee-7b7571f9ce49 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:12.620539 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-67d7fe00-5472-422c-86ee-7b7571f9ce49 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:12.626416 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-67d7fe00-5472-422c-86ee-7b7571f9ce49 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.626862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-67d7fe00-5472-422c-86ee-7b7571f9ce49 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.627731 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-67d7fe00-5472-422c-86ee-7b7571f9ce49 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:12.628173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-67d7fe00-5472-422c-86ee-7b7571f9ce49 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:12.691085 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-67d7fe00-5472-422c-86ee-7b7571f9ce49 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:12.700133 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-67d7fe00-5472-422c-86ee-7b7571f9ce49 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1604 microversion: 2.1 time: 0.084364 May 10 03:19:12.700961 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 308/617] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:12 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1604 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:12.758032 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8ccdff37-0ad7-4d77-bba7-9b8283d8f8a8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:12.765459 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8ccdff37-0ad7-4d77-bba7-9b8283d8f8a8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1691 microversion: 2.1 time: 0.164407 May 10 03:19:12.766044 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 310/618] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:12 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:13.626165 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-97c80eac-9225-4abd-b058-8a81adaeda22 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:13.626779 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-97c80eac-9225-4abd-b058-8a81adaeda22 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:13.633127 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-97c80eac-9225-4abd-b058-8a81adaeda22 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.633573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-97c80eac-9225-4abd-b058-8a81adaeda22 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:13.634335 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-97c80eac-9225-4abd-b058-8a81adaeda22 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.634767 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-97c80eac-9225-4abd-b058-8a81adaeda22 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:13.718093 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5eb36ee5-a747-4cb1-a7f1-1765abc016b0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:13.718794 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5eb36ee5-a747-4cb1-a7f1-1765abc016b0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:13.725469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5eb36ee5-a747-4cb1-a7f1-1765abc016b0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.725993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5eb36ee5-a747-4cb1-a7f1-1765abc016b0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:13.727468 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5eb36ee5-a747-4cb1-a7f1-1765abc016b0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.727966 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5eb36ee5-a747-4cb1-a7f1-1765abc016b0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:13.765876 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-97c80eac-9225-4abd-b058-8a81adaeda22 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:13.773462 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-97c80eac-9225-4abd-b058-8a81adaeda22 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.150971 May 10 03:19:13.774131 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 309/619] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:13 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:13.782376 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b1fc552f-e9f2-4707-8222-b930765a30e5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:13.782981 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b1fc552f-e9f2-4707-8222-b930765a30e5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:13.789805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b1fc552f-e9f2-4707-8222-b930765a30e5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.790248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b1fc552f-e9f2-4707-8222-b930765a30e5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:13.790968 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5eb36ee5-a747-4cb1-a7f1-1765abc016b0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:13.791094 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b1fc552f-e9f2-4707-8222-b930765a30e5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.791430 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b1fc552f-e9f2-4707-8222-b930765a30e5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:13.798452 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5eb36ee5-a747-4cb1-a7f1-1765abc016b0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1320 microversion: 2.1 time: 0.084838 May 10 03:19:13.799135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 311/620] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:13 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1320 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:13.917327 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b1fc552f-e9f2-4707-8222-b930765a30e5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:13.924529 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b1fc552f-e9f2-4707-8222-b930765a30e5 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1691 microversion: 2.1 time: 0.145997 May 10 03:19:13.925129 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 310/621] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:13 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1691 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:14.790470 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f2b78a71-c110-4440-acaa-0fe5e8962aa6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:14.791077 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f2b78a71-c110-4440-acaa-0fe5e8962aa6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:14.797373 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f2b78a71-c110-4440-acaa-0fe5e8962aa6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:14.797816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f2b78a71-c110-4440-acaa-0fe5e8962aa6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:14.798577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f2b78a71-c110-4440-acaa-0fe5e8962aa6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:14.799006 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f2b78a71-c110-4440-acaa-0fe5e8962aa6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:14.815512 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c70eee5d-6b9b-4956-a29b-3f4408106a59 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:14.816155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c70eee5d-6b9b-4956-a29b-3f4408106a59 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:14.823356 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c70eee5d-6b9b-4956-a29b-3f4408106a59 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:14.823994 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c70eee5d-6b9b-4956-a29b-3f4408106a59 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:14.824873 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c70eee5d-6b9b-4956-a29b-3f4408106a59 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:14.825400 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c70eee5d-6b9b-4956-a29b-3f4408106a59 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:14.887219 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c70eee5d-6b9b-4956-a29b-3f4408106a59 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:14.894939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c70eee5d-6b9b-4956-a29b-3f4408106a59 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1320 microversion: 2.1 time: 0.083269 May 10 03:19:14.895710 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 311/622] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:14 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1320 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:14.930207 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f2b78a71-c110-4440-acaa-0fe5e8962aa6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:14.937444 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f2b78a71-c110-4440-acaa-0fe5e8962aa6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.150929 May 10 03:19:14.938013 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 312/623] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:14 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:14.941451 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2398db3a-a5c3-4071-aec9-80f323a5424b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:14.942117 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2398db3a-a5c3-4071-aec9-80f323a5424b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:14.948512 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2398db3a-a5c3-4071-aec9-80f323a5424b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:14.948990 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2398db3a-a5c3-4071-aec9-80f323a5424b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:14.949748 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2398db3a-a5c3-4071-aec9-80f323a5424b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:14.950181 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2398db3a-a5c3-4071-aec9-80f323a5424b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:15.077483 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2398db3a-a5c3-4071-aec9-80f323a5424b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:15.084747 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2398db3a-a5c3-4071-aec9-80f323a5424b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1691 microversion: 2.1 time: 0.147064 May 10 03:19:15.085318 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 312/624] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:14 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1691 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:15.912505 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-94953924-4383-47be-8a06-bc4de6bbaa5b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:15.913146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-94953924-4383-47be-8a06-bc4de6bbaa5b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:15.919950 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-94953924-4383-47be-8a06-bc4de6bbaa5b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:15.920401 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-94953924-4383-47be-8a06-bc4de6bbaa5b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:15.921199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-94953924-4383-47be-8a06-bc4de6bbaa5b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:15.921633 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-94953924-4383-47be-8a06-bc4de6bbaa5b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:15.954528 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9bdf21ee-856a-4570-a0e1-16d47edd4aec tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:15.955139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9bdf21ee-856a-4570-a0e1-16d47edd4aec tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:15.962762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9bdf21ee-856a-4570-a0e1-16d47edd4aec tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:15.963213 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9bdf21ee-856a-4570-a0e1-16d47edd4aec tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:15.964000 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9bdf21ee-856a-4570-a0e1-16d47edd4aec tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:15.964432 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9bdf21ee-856a-4570-a0e1-16d47edd4aec tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:15.984774 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-94953924-4383-47be-8a06-bc4de6bbaa5b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:15.993173 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-94953924-4383-47be-8a06-bc4de6bbaa5b tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 200 len: 1320 microversion: 2.1 time: 0.085122 May 10 03:19:15.994079 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 313/625] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:15 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 1320 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:16.102661 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9bdf21ee-856a-4570-a0e1-16d47edd4aec tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:16.103475 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7dd6bba5-d7f4-4d4f-9676-01a00578581e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:16.104476 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7dd6bba5-d7f4-4d4f-9676-01a00578581e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:16.111565 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7dd6bba5-d7f4-4d4f-9676-01a00578581e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:16.112347 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7dd6bba5-d7f4-4d4f-9676-01a00578581e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:16.113101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9bdf21ee-856a-4570-a0e1-16d47edd4aec tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.162191 May 10 03:19:16.113493 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7dd6bba5-d7f4-4d4f-9676-01a00578581e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:16.123677 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7dd6bba5-d7f4-4d4f-9676-01a00578581e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:16.124092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 313/626] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:15 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:16.245327 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7dd6bba5-d7f4-4d4f-9676-01a00578581e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:16.252586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7dd6bba5-d7f4-4d4f-9676-01a00578581e tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1691 microversion: 2.1 time: 0.155028 May 10 03:19:16.253218 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 314/627] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:16 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:17.010213 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:17.010828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:17.017315 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:17.017759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:17.018533 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:17.018970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:17.033599 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] HTTP exception thrown: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Request method failure captured: May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f HTTP/1.1 May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediTmkCRnC69AbCi4PiV4MwjGxfibgQlE-O7YVwyVd_MGAOic3dGXpsfPi5uIuctVWHuHYSiwwlwC66oOoly_mKq-KX143fMrlmkYTJs6nmvjNlthjqinBHP3Sufn8ditrsIQdSzm9HBNr4QBrsWF3Xz57LGyWsb9AKRUt95wS9W0OQ May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:19:17.035339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5d958793e0ab4e6f8d2f296dcf6186f5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5d958793e0ab4e6f8d2f296dcf6186f5"}]}] May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeTestJSON-821039241 May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeTestJSON-821039241-project May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 314a5e1a357c4a73a33391b6f25a44c6 May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeTestJSON-821039241-project May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:19:17.036906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '03eee221-c04f-48de-b2eb-5e696a377e0f'} May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:17.037815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:19:17.040240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:17.041699 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Returning 404 to user: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:17.041699 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c90ab696-13c5-4c66-8164-fe7e2f8f109e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 404 len: 111 microversion: 2.1 time: 0.032135 May 10 03:19:17.041699 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 314/628] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:17 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:17.055724 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2b568ff8-8b17-4763-ad76-33eb1c0f5c0c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '.version_select at 0x7f14a45fcdc0>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:17.074922 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2b568ff8-8b17-4763-ad76-33eb1c0f5c0c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66328474" status: 202 len: 0 microversion: 2.1 time: 0.029898 May 10 03:19:17.075550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 315/629] 10.222.0.55 () {58 vars in 1214 bytes} [Tue May 10 03:19:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66328474 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:19:17.131496 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-02bc3a86-d02f-45ff-b573-1fa7052bbf40 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:17.132098 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-02bc3a86-d02f-45ff-b573-1fa7052bbf40 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:17.139118 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-02bc3a86-d02f-45ff-b573-1fa7052bbf40 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:17.139582 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-02bc3a86-d02f-45ff-b573-1fa7052bbf40 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:17.140365 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-02bc3a86-d02f-45ff-b573-1fa7052bbf40 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:17.140903 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-02bc3a86-d02f-45ff-b573-1fa7052bbf40 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:17.275156 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-981e152f-70c7-4bd1-806d-7672111d0638 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:17.275790 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-981e152f-70c7-4bd1-806d-7672111d0638 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:17.296016 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-981e152f-70c7-4bd1-806d-7672111d0638 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:17.296484 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-981e152f-70c7-4bd1-806d-7672111d0638 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:17.297842 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-981e152f-70c7-4bd1-806d-7672111d0638 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:17.298348 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-981e152f-70c7-4bd1-806d-7672111d0638 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:17.470583 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-02bc3a86-d02f-45ff-b573-1fa7052bbf40 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:17.479810 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-02bc3a86-d02f-45ff-b573-1fa7052bbf40 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.352285 May 10 03:19:17.481207 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 315/630] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:17 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:17.515933 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-981e152f-70c7-4bd1-806d-7672111d0638 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:17.524233 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-981e152f-70c7-4bd1-806d-7672111d0638 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1691 microversion: 2.1 time: 0.257176 May 10 03:19:17.535106 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 316/631] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:17 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1691 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:17.806972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d84b9ce7-7179-44b2-a68a-9e645e4eaf62 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'create', calling method: .version_select at 0x7f1497d731f0>, body: {"keypair": {"name": "tempest-keypair-58635976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv0fQ72Xr/dafKXrt+Evicj6rBC4lAfK7CcwBWExnJGdQzNSqzk1PlikgXLrjU8NpKINUlnd9LvMNYSn+bdMQVhnFQ3y4ot98xjQG9Er402jroDz9RWv6j5998hPHTGmw=="}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:17.820438 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-d84b9ce7-7179-44b2-a68a-9e645e4eaf62 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Getting quotas for project 5d958793e0ab4e6f8d2f296dcf6186f5. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:17.824759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-d84b9ce7-7179-44b2-a68a-9e645e4eaf62 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Getting quotas for user 314a5e1a357c4a73a33391b6f25a44c6 and project 5d958793e0ab4e6f8d2f296dcf6186f5. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:17.848521 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d84b9ce7-7179-44b2-a68a-9e645e4eaf62 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046053 May 10 03:19:17.849185 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 316/632] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:19:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:18.088608 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-a4752922-3f36-4dc6-824a-039404db3bf8 req-83847362-2789-4c30-8c39-fc21237158e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0144796a-ba13-4fb0-b9a6-ce953cbc7b60", "name": "network-vif-plugged", "status": "completed", "tag": "f02b6a99-10e5-411e-be0e-44e837772e46"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:18.102891 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-a4752922-3f36-4dc6-824a-039404db3bf8 req-83847362-2789-4c30-8c39-fc21237158e5 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.103664 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-a4752922-3f36-4dc6-824a-039404db3bf8 req-83847362-2789-4c30-8c39-fc21237158e5 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.116008 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-a4752922-3f36-4dc6-824a-039404db3bf8 req-83847362-2789-4c30-8c39-fc21237158e5 service nova] Creating event network-vif-plugged:f02b6a99-10e5-411e-be0e-44e837772e46 for instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 on hv-cinder-83009 May 10 03:19:18.123461 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-a4752922-3f36-4dc6-824a-039404db3bf8 req-83847362-2789-4c30-8c39-fc21237158e5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043380 May 10 03:19:18.127164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 317/633] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:18.200555 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-09008318-538d-4229-95af-7951d1c87d0b req-7078fa26-4f25-4757-b94d-9fd0dd436a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b10b34-f1d6-49fe-982c-8d00255bc565", "name": "network-vif-deleted", "tag": "7b55a664-e823-4d00-8935-550519d0fdf6"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:18.214160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-09008318-538d-4229-95af-7951d1c87d0b req-7078fa26-4f25-4757-b94d-9fd0dd436a5e service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.220868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-09008318-538d-4229-95af-7951d1c87d0b req-7078fa26-4f25-4757-b94d-9fd0dd436a5e service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.247397 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-09008318-538d-4229-95af-7951d1c87d0b req-7078fa26-4f25-4757-b94d-9fd0dd436a5e service nova] Creating event network-vif-deleted:7b55a664-e823-4d00-8935-550519d0fdf6 for instance 80b10b34-f1d6-49fe-982c-8d00255bc565 on hv-cinder-83009 May 10 03:19:18.254244 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-09008318-538d-4229-95af-7951d1c87d0b req-7078fa26-4f25-4757-b94d-9fd0dd436a5e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058805 May 10 03:19:18.255022 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 317/634] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:18.498164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4dd62292-f615-446e-8e89-3307f3e69ef0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:18.498873 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4dd62292-f615-446e-8e89-3307f3e69ef0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:18.504981 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4dd62292-f615-446e-8e89-3307f3e69ef0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.505443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4dd62292-f615-446e-8e89-3307f3e69ef0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.506223 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4dd62292-f615-446e-8e89-3307f3e69ef0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.506661 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4dd62292-f615-446e-8e89-3307f3e69ef0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.545580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:18.547114 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:18.555838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.556431 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.557516 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.558197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.595185 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.595808 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.596354 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lazy-loading 'fault' on Instance uuid 80b10b34-f1d6-49fe-982c-8d00255bc565 {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:18.638288 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:18.646006 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-843b29dd-f875-4860-8a86-859209f3b68b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 200 len: 1336 microversion: 2.1 time: 0.107109 May 10 03:19:18.646621 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 318/635] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:18 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:18.707122 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4dd62292-f615-446e-8e89-3307f3e69ef0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:18.716974 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4dd62292-f615-446e-8e89-3307f3e69ef0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.222895 May 10 03:19:18.717554 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 318/636] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:18 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:19.456532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-770661791", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73d317d2-6d6e-4f15-9854-843c84b4e47e"}], "security_groups": [{"name": "tempest-securitygroup--1214793060"}], "key_name": "tempest-keypair-58635976", "user_data": "}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:19.576136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.network.neutron [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] validate_networks() for [('73d317d2-6d6e-4f15-9854-843c84b4e47e', None, None, None, None, None)] {{(pid=117120) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:19:19.660185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-28aece80-676b-4be9-905b-0ec394ee0088 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:19.660821 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-28aece80-676b-4be9-905b-0ec394ee0088 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:19.667511 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28aece80-676b-4be9-905b-0ec394ee0088 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:19.667966 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28aece80-676b-4be9-905b-0ec394ee0088 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:19.668766 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28aece80-676b-4be9-905b-0ec394ee0088 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:19.669200 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28aece80-676b-4be9-905b-0ec394ee0088 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:19.692635 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-28aece80-676b-4be9-905b-0ec394ee0088 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/ips" status: 200 len: 148 microversion: 2.1 time: 0.036822 May 10 03:19:19.699448 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 319/637] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:19:19 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:19.699448 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:19.699448 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: 80b10b34-f1d6-49fe-982c-8d00255bc565] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:19.706008 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:19.706451 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:19.707236 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:19.707669 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:19.722329 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] HTTP exception thrown: Instance 80b10b34-f1d6-49fe-982c-8d00255bc565 could not be found. May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Request method failure captured: May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 HTTP/1.1 May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediXoO1wImN1nMxT7K0VFnyk-ud7eOJBfMgvkNRRRr-cf-c1mcytsGc40j8U9iPKKpvhj7s4rxCFBuOPM9_AXH95peSeHP4-tgZcvutqW8yWliNsFkMABsaym8GaQSqonSfuSW4PejjvkQwy4uAy_wNtzWSflyQWwONBu9NEa0mM9bE May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: d2279255bed8483c82ba27a2451313fc May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:19:19.724108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d2279255bed8483c82ba27a2451313fc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d2279255bed8483c82ba27a2451313fc"}]}] May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: d2279255bed8483c82ba27a2451313fc May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 6dac5d7569d4402ca9c910ea8862b5d9 May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 80b10b34-f1d6-49fe-982c-8d00255bc565 could not be found. May 10 03:19:19.725681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '80b10b34-f1d6-49fe-982c-8d00255bc565'} May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b10b34-f1d6-49fe-982c-8d00255bc565 could not be found. May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:19.726618 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b10b34-f1d6-49fe-982c-8d00255bc565 could not be found. May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b10b34-f1d6-49fe-982c-8d00255bc565 could not be found. May 10 03:19:19.732893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:19.734199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Returning 404 to user: Instance 80b10b34-f1d6-49fe-982c-8d00255bc565 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:19.734199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b85fd0f9-3d18-4ddb-bec9-5b846bf77ad9 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565" status: 404 len: 111 microversion: 2.1 time: 0.033912 May 10 03:19:19.734199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 320/638] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:19 2022] GET /compute/v2.1/servers/80b10b34-f1d6-49fe-982c-8d00255bc565 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:19.735995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-47d30f04-d7cc-48a1-98c6-8a621149071c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:19.736759 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-47d30f04-d7cc-48a1-98c6-8a621149071c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:19.744122 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-47d30f04-d7cc-48a1-98c6-8a621149071c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:19.744763 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-47d30f04-d7cc-48a1-98c6-8a621149071c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:19.745641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-47d30f04-d7cc-48a1-98c6-8a621149071c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:19.746138 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-47d30f04-d7cc-48a1-98c6-8a621149071c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:19.893329 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-47d30f04-d7cc-48a1-98c6-8a621149071c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:19.902189 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-47d30f04-d7cc-48a1-98c6-8a621149071c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1359 microversion: 2.1 time: 0.172212 May 10 03:19:19.902770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 321/639] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:19 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:19.907425 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4f3659be-e909-475b-9653-8332663b7e68 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '.version_select at 0x7f14a468d430>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:19.925368 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4f3659be-e909-475b-9653-8332663b7e68 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692384457" status: 202 len: 0 microversion: 2.1 time: 0.021514 May 10 03:19:19.926343 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 322/640] 10.222.0.55 () {58 vars in 1220 bytes} [Tue May 10 03:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692384457 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:19:20.000828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Flavor limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:19:20.001264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Image limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:19:20.001888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Flavor pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:19:20.002480 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Image pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:19:20.002899 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:19:20.014624 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:20.015157 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:20.016297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:20.016763 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:20.034979 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Getting quotas for project 5d958793e0ab4e6f8d2f296dcf6186f5. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:20.040153 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Getting quotas for user 314a5e1a357c4a73a33391b6f25a44c6 and project 5d958793e0ab4e6f8d2f296dcf6186f5. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:20.055171 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Going to run 1 instances... {{(pid=117120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:19:20.057691 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:19:20.113792 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-bc970275-202e-4e38-8bb3-4ff80b51acd7 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.662586 May 10 03:19:20.125727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7f7e29fb-23b5-4fbf-bf08-71725a15834a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:20.126457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7f7e29fb-23b5-4fbf-bf08-71725a15834a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:20.129741 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 319/641] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:19:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:19:20.196001 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7f7e29fb-23b5-4fbf-bf08-71725a15834a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:20.202867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7f7e29fb-23b5-4fbf-bf08-71725a15834a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1235 microversion: 2.1 time: 0.081132 May 10 03:19:20.203523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 323/642] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:20 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1235 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:20.920506 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-41a2b996-ae65-458b-8f4f-9ca6bb8242b3 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:20.921166 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-41a2b996-ae65-458b-8f4f-9ca6bb8242b3 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:20.928058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-41a2b996-ae65-458b-8f4f-9ca6bb8242b3 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:20.928586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-41a2b996-ae65-458b-8f4f-9ca6bb8242b3 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:20.929970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-41a2b996-ae65-458b-8f4f-9ca6bb8242b3 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:20.930423 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-41a2b996-ae65-458b-8f4f-9ca6bb8242b3 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.064646 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-41a2b996-ae65-458b-8f4f-9ca6bb8242b3 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:21.067138 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b5b4bff1-8219-40e0-8ffa-70563e584a80 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b6bccaa-4cc2-459a-aacb-967b84e8952f"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:21.068302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b5b4bff1-8219-40e0-8ffa-70563e584a80 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:21.073638 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-41a2b996-ae65-458b-8f4f-9ca6bb8242b3 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1550 microversion: 2.1 time: 0.158193 May 10 03:19:21.079341 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 320/643] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:20 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:21.079504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b5b4bff1-8219-40e0-8ffa-70563e584a80 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.079504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b5b4bff1-8219-40e0-8ffa-70563e584a80 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.079504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b5b4bff1-8219-40e0-8ffa-70563e584a80 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.079504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b5b4bff1-8219-40e0-8ffa-70563e584a80 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.090610 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-238f46b6-3363-4fbf-ac26-41921310a363 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:21.091222 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-238f46b6-3363-4fbf-ac26-41921310a363 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:21.097326 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-238f46b6-3363-4fbf-ac26-41921310a363 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.097790 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-238f46b6-3363-4fbf-ac26-41921310a363 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.098581 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-238f46b6-3363-4fbf-ac26-41921310a363 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.099001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-238f46b6-3363-4fbf-ac26-41921310a363 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.265984 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-238f46b6-3363-4fbf-ac26-41921310a363 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:21.275861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-238f46b6-3363-4fbf-ac26-41921310a363 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1550 microversion: 2.1 time: 0.188936 May 10 03:19:21.276992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 321/644] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:21 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1550 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:21.282951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5a590bb9-6fd1-46ae-abfc-5d889805bcde tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:21.283709 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5a590bb9-6fd1-46ae-abfc-5d889805bcde tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:21.291108 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5a590bb9-6fd1-46ae-abfc-5d889805bcde tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.291768 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5a590bb9-6fd1-46ae-abfc-5d889805bcde tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.292747 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5a590bb9-6fd1-46ae-abfc-5d889805bcde tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.293375 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5a590bb9-6fd1-46ae-abfc-5d889805bcde tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.372030 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5a590bb9-6fd1-46ae-abfc-5d889805bcde tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:21.381295 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5a590bb9-6fd1-46ae-abfc-5d889805bcde tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1295 microversion: 2.1 time: 0.103109 May 10 03:19:21.382120 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 322/645] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:21 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:21.387844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1be68dc1-092f-4656-9b26-c225faed2c4c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:21.391401 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1be68dc1-092f-4656-9b26-c225faed2c4c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:21.392192 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1be68dc1-092f-4656-9b26-c225faed2c4c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Searching by: {'deleted': False, 'project_id': 'b79f1de979384c108b5ff0427e44e30b'} {{(pid=117120) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 03:19:21.401239 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1be68dc1-092f-4656-9b26-c225faed2c4c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.401900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1be68dc1-092f-4656-9b26-c225faed2c4c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.402375 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b5b4bff1-8219-40e0-8ffa-70563e584a80 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338655 May 10 03:19:21.402914 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1be68dc1-092f-4656-9b26-c225faed2c4c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.403358 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1be68dc1-092f-4656-9b26-c225faed2c4c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.404127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 324/646] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:19:21 2022] POST /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:21.507750 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.multi_cell_list [None req-1be68dc1-092f-4656-9b26-c225faed2c4c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 03:19:21.609314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1be68dc1-092f-4656-9b26-c225faed2c4c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225118 May 10 03:19:21.610104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 323/647] 10.222.0.55 () {58 vars in 1124 bytes} [Tue May 10 03:19:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:21.622033 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d6903502-0577-4cb3-b796-4fd6239ecfd5 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:21.623453 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d6903502-0577-4cb3-b796-4fd6239ecfd5 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:21.631828 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d6903502-0577-4cb3-b796-4fd6239ecfd5 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.633057 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d6903502-0577-4cb3-b796-4fd6239ecfd5 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.633959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d6903502-0577-4cb3-b796-4fd6239ecfd5 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:21.634397 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d6903502-0577-4cb3-b796-4fd6239ecfd5 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.768355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d6903502-0577-4cb3-b796-4fd6239ecfd5 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:21.778369 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d6903502-0577-4cb3-b796-4fd6239ecfd5 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1550 microversion: 2.1 time: 0.161982 May 10 03:19:21.779366 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 325/648] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:21 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:22.400001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-33cda5c6-ad24-4753-900a-3e9e8ef0cddd tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:22.400791 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-33cda5c6-ad24-4753-900a-3e9e8ef0cddd tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:22.408691 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-33cda5c6-ad24-4753-900a-3e9e8ef0cddd tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:22.409152 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-33cda5c6-ad24-4753-900a-3e9e8ef0cddd tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:22.410057 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-33cda5c6-ad24-4753-900a-3e9e8ef0cddd tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:22.410580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-33cda5c6-ad24-4753-900a-3e9e8ef0cddd tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:22.611864 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-33cda5c6-ad24-4753-900a-3e9e8ef0cddd tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:22.621182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-33cda5c6-ad24-4753-900a-3e9e8ef0cddd tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.226173 May 10 03:19:22.622159 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 324/649] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:22 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:22.625168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ec397bbc-125c-4b45-a0b1-94a5a1b799ff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:22.625717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ec397bbc-125c-4b45-a0b1-94a5a1b799ff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:22.631849 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec397bbc-125c-4b45-a0b1-94a5a1b799ff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:22.633144 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec397bbc-125c-4b45-a0b1-94a5a1b799ff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:22.633921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec397bbc-125c-4b45-a0b1-94a5a1b799ff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:22.634351 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec397bbc-125c-4b45-a0b1-94a5a1b799ff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:22.657554 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ec397bbc-125c-4b45-a0b1-94a5a1b799ff tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/ips" status: 200 len: 150 microversion: 2.20 time: 0.036242 May 10 03:19:22.663214 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 326/650] 10.222.0.55 () {60 vars in 1288 bytes} [Tue May 10 03:19:22 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:19:22.910886 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-b12b4aa5-4ffe-45a0-8f97-c7571097dbbc req-0e5016fb-8c13-41fc-92c6-93ec7d530522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3477a576-5f17-49ed-9b21-6fb4c6c52dd7", "tag": "fb909d63-5bc0-4574-995b-4f7117c39bab"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:22.923555 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-b12b4aa5-4ffe-45a0-8f97-c7571097dbbc req-0e5016fb-8c13-41fc-92c6-93ec7d530522 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:22.924236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-b12b4aa5-4ffe-45a0-8f97-c7571097dbbc req-0e5016fb-8c13-41fc-92c6-93ec7d530522 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:22.972872 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-b12b4aa5-4ffe-45a0-8f97-c7571097dbbc req-0e5016fb-8c13-41fc-92c6-93ec7d530522 service nova] Creating event network-changed:fb909d63-5bc0-4574-995b-4f7117c39bab for instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 on hv-cinder-83009 May 10 03:19:22.983408 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-b12b4aa5-4ffe-45a0-8f97-c7571097dbbc req-0e5016fb-8c13-41fc-92c6-93ec7d530522 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081265 May 10 03:19:22.984286 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 325/651] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:23.196219 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-947e50d4-bf2f-47e8-9870-7cfb9c16af0c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:23.196751 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-947e50d4-bf2f-47e8-9870-7cfb9c16af0c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:23.205921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-947e50d4-bf2f-47e8-9870-7cfb9c16af0c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.206285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-947e50d4-bf2f-47e8-9870-7cfb9c16af0c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.207288 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-947e50d4-bf2f-47e8-9870-7cfb9c16af0c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.207745 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-947e50d4-bf2f-47e8-9870-7cfb9c16af0c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.245734 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-947e50d4-bf2f-47e8-9870-7cfb9c16af0c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:19:23.330375 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-947e50d4-bf2f-47e8-9870-7cfb9c16af0c tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 204 len: 0 microversion: 2.1 time: 0.138498 May 10 03:19:23.331266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 327/652] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:19:23 2022] DELETE /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:19:23.340479 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-bbd5cae7-f869-42f8-ab88-0e950e57cbe7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:23.341385 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-bbd5cae7-f869-42f8-ab88-0e950e57cbe7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:23.347887 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bbd5cae7-f869-42f8-ab88-0e950e57cbe7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.348337 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bbd5cae7-f869-42f8-ab88-0e950e57cbe7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.349149 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bbd5cae7-f869-42f8-ab88-0e950e57cbe7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.349585 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bbd5cae7-f869-42f8-ab88-0e950e57cbe7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.374801 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-218ab8a7-ad6f-43be-b574-561543ffc616 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9d19f94-b651-4f4e-a022-0ccda4299ea4"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:23.376200 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-218ab8a7-ad6f-43be-b574-561543ffc616 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:23.382781 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-218ab8a7-ad6f-43be-b574-561543ffc616 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.383249 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-218ab8a7-ad6f-43be-b574-561543ffc616 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.384013 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-218ab8a7-ad6f-43be-b574-561543ffc616 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.384445 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-218ab8a7-ad6f-43be-b574-561543ffc616 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.486479 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-bbd5cae7-f869-42f8-ab88-0e950e57cbe7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:23.494416 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-bbd5cae7-f869-42f8-ab88-0e950e57cbe7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1507 microversion: 2.1 time: 0.159179 May 10 03:19:23.495022 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 326/653] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:23 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:23.638685 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-90751678-71ab-4faa-9455-d42e22956594 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:23.639303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-90751678-71ab-4faa-9455-d42e22956594 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:23.645165 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-90751678-71ab-4faa-9455-d42e22956594 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.645610 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-90751678-71ab-4faa-9455-d42e22956594 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.646375 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-90751678-71ab-4faa-9455-d42e22956594 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.646804 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-90751678-71ab-4faa-9455-d42e22956594 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.776116 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-90751678-71ab-4faa-9455-d42e22956594 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:23.783588 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-90751678-71ab-4faa-9455-d42e22956594 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.148696 May 10 03:19:23.784156 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 327/654] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:23 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:24.510980 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-99596fc8-1f09-4552-9aae-a5eb254cafc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:24.511663 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-99596fc8-1f09-4552-9aae-a5eb254cafc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:24.518101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-99596fc8-1f09-4552-9aae-a5eb254cafc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.518545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-99596fc8-1f09-4552-9aae-a5eb254cafc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.519303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-99596fc8-1f09-4552-9aae-a5eb254cafc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.519728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-99596fc8-1f09-4552-9aae-a5eb254cafc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.647117 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-99596fc8-1f09-4552-9aae-a5eb254cafc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:24.655624 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-99596fc8-1f09-4552-9aae-a5eb254cafc8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1507 microversion: 2.1 time: 0.148770 May 10 03:19:24.656203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 328/655] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:24 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:24.761754 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1da596d5-18d9-4c0c-bac5-925682a745be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:24.762251 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1da596d5-18d9-4c0c-bac5-925682a745be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:24.767983 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1da596d5-18d9-4c0c-bac5-925682a745be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.768427 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1da596d5-18d9-4c0c-bac5-925682a745be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.769217 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1da596d5-18d9-4c0c-bac5-925682a745be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.769689 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1da596d5-18d9-4c0c-bac5-925682a745be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.792168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-1da596d5-18d9-4c0c-bac5-925682a745be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lazy-loading 'flavor' on Instance uuid 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:25.042155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1da596d5-18d9-4c0c-bac5-925682a745be tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/action" status: 202 len: 0 microversion: 2.20 time: 0.384723 May 10 03:19:25.045801 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 329/656] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 10 03:19:24 2022] POST /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:19:25.047801 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-03623e2e-3126-47d3-b427-658473892c50 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:25.048493 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-03623e2e-3126-47d3-b427-658473892c50 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:25.055343 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-03623e2e-3126-47d3-b427-658473892c50 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:25.055785 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-03623e2e-3126-47d3-b427-658473892c50 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:25.056549 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-03623e2e-3126-47d3-b427-658473892c50 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:25.057012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-03623e2e-3126-47d3-b427-658473892c50 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:25.187445 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-03623e2e-3126-47d3-b427-658473892c50 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:25.205418 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-03623e2e-3126-47d3-b427-658473892c50 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.159732 May 10 03:19:25.206160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 330/657] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:25 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:25.211969 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:25.212859 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:25.220420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:25.220892 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:25.221657 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:25.222089 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:25.351810 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:25.359516 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:25.361083 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:25.362232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d33d91f6-9965-44ed-b393-537e12b86bfc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.154288 May 10 03:19:25.362832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 331/658] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:25 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:25.672627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5044f2ba-e665-4795-977d-c55955dbff6b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:25.673247 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5044f2ba-e665-4795-977d-c55955dbff6b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:25.679531 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5044f2ba-e665-4795-977d-c55955dbff6b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:25.679973 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5044f2ba-e665-4795-977d-c55955dbff6b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:25.680758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5044f2ba-e665-4795-977d-c55955dbff6b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:25.681218 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5044f2ba-e665-4795-977d-c55955dbff6b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:25.809337 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5044f2ba-e665-4795-977d-c55955dbff6b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:25.816620 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5044f2ba-e665-4795-977d-c55955dbff6b tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1507 microversion: 2.1 time: 0.147806 May 10 03:19:25.817215 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 332/659] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:25 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:26.223050 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cca91be8-65d2-47f0-beec-f6e93df8b11d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:26.223871 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-cca91be8-65d2-47f0-beec-f6e93df8b11d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:26.230693 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cca91be8-65d2-47f0-beec-f6e93df8b11d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.231192 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cca91be8-65d2-47f0-beec-f6e93df8b11d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.231965 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cca91be8-65d2-47f0-beec-f6e93df8b11d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.232390 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cca91be8-65d2-47f0-beec-f6e93df8b11d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.337957 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-218ab8a7-ad6f-43be-b574-561543ffc616 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "POST /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.967365 May 10 03:19:26.338514 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 328/660] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:19:23 2022] POST /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments => generated 194 bytes in 2969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:26.383710 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:26.384753 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:26.392216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.393097 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.394170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.394748 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.531355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:26.539315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:26.541061 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:26.542227 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2ace0e92-4e33-46a4-832c-4c8e7efeeff4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.164779 May 10 03:19:26.542794 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 329/661] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:26 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:19:26.561027 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-cca91be8-65d2-47f0-beec-f6e93df8b11d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:26.568109 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-cca91be8-65d2-47f0-beec-f6e93df8b11d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.348941 May 10 03:19:26.568701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 333/662] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:26 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:26.833611 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9765d58c-9b3b-44b5-a249-4fc182f27de3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:26.834345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9765d58c-9b3b-44b5-a249-4fc182f27de3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:26.840740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9765d58c-9b3b-44b5-a249-4fc182f27de3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.841185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9765d58c-9b3b-44b5-a249-4fc182f27de3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.842050 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9765d58c-9b3b-44b5-a249-4fc182f27de3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.842484 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9765d58c-9b3b-44b5-a249-4fc182f27de3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.994728 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9765d58c-9b3b-44b5-a249-4fc182f27de3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.011274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9765d58c-9b3b-44b5-a249-4fc182f27de3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1507 microversion: 2.1 time: 0.181398 May 10 03:19:27.016802 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 330/663] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:26 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:27.072362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-b4180af3-08a5-4c38-812a-a85ceeac9454 req-530b2c20-ac77-4034-a40f-dbe14d44e515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c84baa-9dcf-42e3-bd13-d86cf6b59832", "name": "network-vif-deleted", "tag": "b9d6cae9-1585-4490-82f6-fb9945c58311"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:27.081089 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-b4180af3-08a5-4c38-812a-a85ceeac9454 req-530b2c20-ac77-4034-a40f-dbe14d44e515 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.081725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-b4180af3-08a5-4c38-812a-a85ceeac9454 req-530b2c20-ac77-4034-a40f-dbe14d44e515 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.094172 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-b4180af3-08a5-4c38-812a-a85ceeac9454 req-530b2c20-ac77-4034-a40f-dbe14d44e515 service nova] Creating event network-vif-deleted:b9d6cae9-1585-4490-82f6-fb9945c58311 for instance c8c84baa-9dcf-42e3-bd13-d86cf6b59832 on hv-cinder-83009 May 10 03:19:27.104062 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-b4180af3-08a5-4c38-812a-a85ceeac9454 req-530b2c20-ac77-4034-a40f-dbe14d44e515 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036834 May 10 03:19:27.104854 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 334/664] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:27.560531 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:27.561164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:27.567527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.567923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.568701 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.569135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.585851 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5f0bff31-5524-46ec-9c7b-6d8dd7fee12d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:27.587105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5f0bff31-5524-46ec-9c7b-6d8dd7fee12d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:27.593113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f0bff31-5524-46ec-9c7b-6d8dd7fee12d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.593562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f0bff31-5524-46ec-9c7b-6d8dd7fee12d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.594342 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f0bff31-5524-46ec-9c7b-6d8dd7fee12d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.594777 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f0bff31-5524-46ec-9c7b-6d8dd7fee12d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.701344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.712910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.714769 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.716706 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-353e2498-6f93-4def-86a7-a6c9be91869d tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.159421 May 10 03:19:27.717407 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 331/665] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:27 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:27.778951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5f0bff31-5524-46ec-9c7b-6d8dd7fee12d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.786511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5f0bff31-5524-46ec-9c7b-6d8dd7fee12d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.204872 May 10 03:19:27.787087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 335/666] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:27 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:28.031071 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:28.031712 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:28.037971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.038805 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.040222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.040858 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.100637 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.102319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.103071 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lazy-loading 'fault' on Instance uuid c8c84baa-9dcf-42e3-bd13-d86cf6b59832 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:28.153167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.173689 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4de1f3b8-953e-42b3-9268-bfc7c373145a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 200 len: 1311 microversion: 2.1 time: 0.150005 May 10 03:19:28.185729 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 332/667] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:28 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 1311 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:28.734721 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:28.735327 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:28.741637 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.742618 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.743459 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.743888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.803271 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2056101d-91fd-4854-b5f7-70ce0cf9ebac tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:28.803930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2056101d-91fd-4854-b5f7-70ce0cf9ebac tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:28.811785 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2056101d-91fd-4854-b5f7-70ce0cf9ebac tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.812242 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2056101d-91fd-4854-b5f7-70ce0cf9ebac tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.813049 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2056101d-91fd-4854-b5f7-70ce0cf9ebac tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.813487 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2056101d-91fd-4854-b5f7-70ce0cf9ebac tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.871474 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.879348 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.880945 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.882138 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-53c94fa6-7d65-4e1f-bbcb-1c271384bb26 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.151327 May 10 03:19:28.882747 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 336/668] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:28 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:28.942276 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2056101d-91fd-4854-b5f7-70ce0cf9ebac tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.950066 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2056101d-91fd-4854-b5f7-70ce0cf9ebac tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.150707 May 10 03:19:28.950638 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 333/669] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:28 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:29.061926 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b6bccaa-4cc2-459a-aacb-967b84e8952f"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:29.063060 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.068969 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.069415 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.070167 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.071410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.148310 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Invalid volume: volume 2b6bccaa-4cc2-459a-aacb-967b84e8952f is already attached to instances: 972b595f-8244-44db-a40a-203044d9c20c May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: POST /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments HTTP/1.1 May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 74 May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:19:29.150147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {"volumeAttachment": {"volumeId": "2b6bccaa-4cc2-459a-aacb-967b84e8952f"}} May 10 03:19:29.151695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Invalid volume: volume 2b6bccaa-4cc2-459a-aacb-967b84e8952f is already attached to instances: 972b595f-8244-44db-a40a-203044d9c20c May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'server_id': '972b595f-8244-44db-a40a-203044d9c20c', 'body': {'volumeAttachment': {'volumeId': '2b6bccaa-4cc2-459a-aacb-967b84e8952f'}}} May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2b6bccaa-4cc2-459a-aacb-967b84e8952f is already attached to instances: 972b595f-8244-44db-a40a-203044d9c20c May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:29.152558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2b6bccaa-4cc2-459a-aacb-967b84e8952f is already attached to instances: 972b595f-8244-44db-a40a-203044d9c20c May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:29.153939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:29.155706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:29.155706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:29.155706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:29.155706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2b6bccaa-4cc2-459a-aacb-967b84e8952f is already attached to instances: 972b595f-8244-44db-a40a-203044d9c20c May 10 03:19:29.155706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:29.155706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 400 to user: Invalid volume: volume 2b6bccaa-4cc2-459a-aacb-967b84e8952f is already attached to instances: 972b595f-8244-44db-a40a-203044d9c20c {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:29.155706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-dd7623b3-5532-479c-afb1-753164a2ca92 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093653 May 10 03:19:29.155706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 337/670] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:19:29 2022] POST /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:19:29.193179 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.193858 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: c8c84baa-9dcf-42e3-bd13-d86cf6b59832] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.199844 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.200289 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.201083 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.201676 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.211302 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3c279c50-76b1-4d44-ada2-0083386ce566 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.212148 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3c279c50-76b1-4d44-ada2-0083386ce566 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.214951 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] HTTP exception thrown: Instance c8c84baa-9dcf-42e3-bd13-d86cf6b59832 could not be found. May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Request method failure captured: May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 HTTP/1.1 May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediXoO1wImN1nMxT7K0VFnyk-ud7eOJBfMgvkNRRRr-cf-c1mcytsGc40j8U9iPKKpvhj7s4rxCFBuOPM9_AXH95peSeHP4-tgZcvutqW8yWliNsFkMABsaym8GaQSqonSfuSW4PejjvkQwy4uAy_wNtzWSflyQWwONBu9NEa0mM9bE May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: d2279255bed8483c82ba27a2451313fc May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:19:29.216577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d2279255bed8483c82ba27a2451313fc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d2279255bed8483c82ba27a2451313fc"}]}] May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: d2279255bed8483c82ba27a2451313fc May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 6dac5d7569d4402ca9c910ea8862b5d9 May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance c8c84baa-9dcf-42e3-bd13-d86cf6b59832 could not be found. May 10 03:19:29.217859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': 'c8c84baa-9dcf-42e3-bd13-d86cf6b59832'} May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c84baa-9dcf-42e3-bd13-d86cf6b59832 could not be found. May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:29.218586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c84baa-9dcf-42e3-bd13-d86cf6b59832 could not be found. May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c84baa-9dcf-42e3-bd13-d86cf6b59832 could not be found. May 10 03:19:29.220153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:19:29.222035 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Returning 404 to user: Instance c8c84baa-9dcf-42e3-bd13-d86cf6b59832 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:29.222035 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fa5503c7-2399-4cd7-b50f-40aa3bcc5cd3 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832" status: 404 len: 111 microversion: 2.1 time: 0.028776 May 10 03:19:29.222192 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3c279c50-76b1-4d44-ada2-0083386ce566 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.222192 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3c279c50-76b1-4d44-ada2-0083386ce566 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.222363 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 334/671] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:29 2022] GET /compute/v2.1/servers/c8c84baa-9dcf-42e3-bd13-d86cf6b59832 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:29.222515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3c279c50-76b1-4d44-ada2-0083386ce566 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.222515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3c279c50-76b1-4d44-ada2-0083386ce566 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.226272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3f5b432a-b090-4959-8cb2-5567eb9f675a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.227385 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3f5b432a-b090-4959-8cb2-5567eb9f675a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.233276 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3f5b432a-b090-4959-8cb2-5567eb9f675a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.233729 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3f5b432a-b090-4959-8cb2-5567eb9f675a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.234492 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3f5b432a-b090-4959-8cb2-5567eb9f675a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.234929 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3f5b432a-b090-4959-8cb2-5567eb9f675a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.263058 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3f5b432a-b090-4959-8cb2-5567eb9f675a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:19:29.299324 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-3c279c50-76b1-4d44-ada2-0083386ce566 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lazy-loading 'services' on Instance uuid 972b595f-8244-44db-a40a-203044d9c20c {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:29.341016 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3f5b432a-b090-4959-8cb2-5567eb9f675a tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 204 len: 0 microversion: 2.1 time: 0.117984 May 10 03:19:29.341816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 335/672] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:19:29 2022] DELETE /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:19:29.349650 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4f20715a-d378-4b38-b1a0-baeceebaddc0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.350358 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4f20715a-d378-4b38-b1a0-baeceebaddc0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.357117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4f20715a-d378-4b38-b1a0-baeceebaddc0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.357419 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4f20715a-d378-4b38-b1a0-baeceebaddc0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.358383 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4f20715a-d378-4b38-b1a0-baeceebaddc0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.358694 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4f20715a-d378-4b38-b1a0-baeceebaddc0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.374784 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3c279c50-76b1-4d44-ada2-0083386ce566 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments/2b6bccaa-4cc2-459a-aacb-967b84e8952f" status: 202 len: 0 microversion: 2.1 time: 0.167306 May 10 03:19:29.375360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 338/673] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:19:29 2022] DELETE /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments/2b6bccaa-4cc2-459a-aacb-967b84e8952f => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:19:29.384812 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-94220edc-df89-4d02-a06b-47cb7ff76985 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.386392 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-94220edc-df89-4d02-a06b-47cb7ff76985 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.394107 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-94220edc-df89-4d02-a06b-47cb7ff76985 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.394550 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-94220edc-df89-4d02-a06b-47cb7ff76985 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.395311 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-94220edc-df89-4d02-a06b-47cb7ff76985 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.395735 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-94220edc-df89-4d02-a06b-47cb7ff76985 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.426172 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-94220edc-df89-4d02-a06b-47cb7ff76985 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046319 May 10 03:19:29.426917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 339/674] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:29 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:29.489653 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4f20715a-d378-4b38-b1a0-baeceebaddc0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:29.497205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4f20715a-d378-4b38-b1a0-baeceebaddc0 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.151472 May 10 03:19:29.497770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 336/675] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:29 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:29.901689 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.902223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.908783 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.909229 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.909987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.910421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.967243 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-085ed217-543a-4c12-bf64-eabb5cf47a00 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.967850 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-085ed217-543a-4c12-bf64-eabb5cf47a00 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.975391 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-085ed217-543a-4c12-bf64-eabb5cf47a00 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.975845 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-085ed217-543a-4c12-bf64-eabb5cf47a00 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.977350 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-085ed217-543a-4c12-bf64-eabb5cf47a00 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.977949 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-085ed217-543a-4c12-bf64-eabb5cf47a00 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.049915 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.060701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.063562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.065148 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a7a07eb0-c281-4301-9931-32b28fbc4d1e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.168374 May 10 03:19:30.066311 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 340/676] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:29 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:30.122903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-085ed217-543a-4c12-bf64-eabb5cf47a00 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.130399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-085ed217-543a-4c12-bf64-eabb5cf47a00 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.166921 May 10 03:19:30.130971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 337/677] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:29 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:30.146822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-14c7d2a3-0810-472f-be4f-d9d789acf597 req-a7b80157-384c-4236-b48d-32a2abd53e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3477a576-5f17-49ed-9b21-6fb4c6c52dd7", "name": "network-vif-plugged", "status": "completed", "tag": "fb909d63-5bc0-4574-995b-4f7117c39bab"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:30.156729 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-14c7d2a3-0810-472f-be4f-d9d789acf597 req-a7b80157-384c-4236-b48d-32a2abd53e14 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.157247 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-14c7d2a3-0810-472f-be4f-d9d789acf597 req-a7b80157-384c-4236-b48d-32a2abd53e14 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.170991 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-14c7d2a3-0810-472f-be4f-d9d789acf597 req-a7b80157-384c-4236-b48d-32a2abd53e14 service nova] Creating event network-vif-plugged:fb909d63-5bc0-4574-995b-4f7117c39bab for instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 on hv-cinder-83009 May 10 03:19:30.176065 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-14c7d2a3-0810-472f-be4f-d9d789acf597 req-a7b80157-384c-4236-b48d-32a2abd53e14 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033041 May 10 03:19:30.176774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 341/678] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:30.437902 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-58ce71e6-eb36-4d46-8e31-b34c7f0b4e18 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:30.438840 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-58ce71e6-eb36-4d46-8e31-b34c7f0b4e18 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:30.444694 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-58ce71e6-eb36-4d46-8e31-b34c7f0b4e18 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.445205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-58ce71e6-eb36-4d46-8e31-b34c7f0b4e18 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.446583 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-58ce71e6-eb36-4d46-8e31-b34c7f0b4e18 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.447013 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-58ce71e6-eb36-4d46-8e31-b34c7f0b4e18 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.474520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-58ce71e6-eb36-4d46-8e31-b34c7f0b4e18 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040646 May 10 03:19:30.475062 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 338/679] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:30 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:30.514473 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9fb254cd-80e4-4164-837e-f910e8ce8064 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:30.515166 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9fb254cd-80e4-4164-837e-f910e8ce8064 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:30.521216 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9fb254cd-80e4-4164-837e-f910e8ce8064 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.521659 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9fb254cd-80e4-4164-837e-f910e8ce8064 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.522413 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9fb254cd-80e4-4164-837e-f910e8ce8064 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.522843 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9fb254cd-80e4-4164-837e-f910e8ce8064 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.650363 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9fb254cd-80e4-4164-837e-f910e8ce8064 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.657945 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9fb254cd-80e4-4164-837e-f910e8ce8064 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.147688 May 10 03:19:30.658516 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 342/680] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:30 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:31.083893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:31.084497 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:31.091328 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.091770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.092528 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.092994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.147406 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7fc2444a-e68c-42c8-9cbd-42db58608a46 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:31.148021 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7fc2444a-e68c-42c8-9cbd-42db58608a46 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:31.154876 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7fc2444a-e68c-42c8-9cbd-42db58608a46 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.155578 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7fc2444a-e68c-42c8-9cbd-42db58608a46 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.156358 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7fc2444a-e68c-42c8-9cbd-42db58608a46 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.156827 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7fc2444a-e68c-42c8-9cbd-42db58608a46 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.226330 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.234883 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.236387 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.237575 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-64323256-86ef-4074-bbce-38222647c630 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.157576 May 10 03:19:31.238131 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 339/681] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:31 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:31.285678 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-7fc2444a-e68c-42c8-9cbd-42db58608a46 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.293755 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7fc2444a-e68c-42c8-9cbd-42db58608a46 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.150259 May 10 03:19:31.294318 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 343/682] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:31 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:31.486793 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7d60972a-aeff-4724-a31b-fd38ee290d2f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:31.487879 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7d60972a-aeff-4724-a31b-fd38ee290d2f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:31.494625 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d60972a-aeff-4724-a31b-fd38ee290d2f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.495067 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d60972a-aeff-4724-a31b-fd38ee290d2f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.495821 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d60972a-aeff-4724-a31b-fd38ee290d2f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.496255 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d60972a-aeff-4724-a31b-fd38ee290d2f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.524892 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7d60972a-aeff-4724-a31b-fd38ee290d2f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042235 May 10 03:19:31.525431 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 340/683] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:31 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:31.770628 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fcdc447a-4881-44b3-b156-bad5853f50b7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:31.771260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-fcdc447a-4881-44b3-b156-bad5853f50b7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:31.777768 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fcdc447a-4881-44b3-b156-bad5853f50b7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.778211 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fcdc447a-4881-44b3-b156-bad5853f50b7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.778964 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fcdc447a-4881-44b3-b156-bad5853f50b7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.779393 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fcdc447a-4881-44b3-b156-bad5853f50b7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.904755 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fcdc447a-4881-44b3-b156-bad5853f50b7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.912197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-fcdc447a-4881-44b3-b156-bad5853f50b7 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1521 microversion: 2.1 time: 0.241387 May 10 03:19:31.912789 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 344/684] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:31 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:32.256338 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:32.256983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:32.263493 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.263933 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.264746 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.265169 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.310619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ec7aecc4-743c-4a63-91ec-8ac4a1aa2b95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:32.311832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ec7aecc4-743c-4a63-91ec-8ac4a1aa2b95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:32.318182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ec7aecc4-743c-4a63-91ec-8ac4a1aa2b95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.318567 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ec7aecc4-743c-4a63-91ec-8ac4a1aa2b95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.319329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ec7aecc4-743c-4a63-91ec-8ac4a1aa2b95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.319754 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ec7aecc4-743c-4a63-91ec-8ac4a1aa2b95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.399806 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.408503 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.410329 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.412250 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-48349514-5368-4f7a-8b6c-90f0afeac9f5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.159265 May 10 03:19:32.413223 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 341/685] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:32 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:32.473155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ec7aecc4-743c-4a63-91ec-8ac4a1aa2b95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.481069 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ec7aecc4-743c-4a63-91ec-8ac4a1aa2b95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.174276 May 10 03:19:32.481648 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 345/686] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:32 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:32.535797 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-6380626a-5544-4c0d-ba01-456a6a9c09ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:32.536864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-6380626a-5544-4c0d-ba01-456a6a9c09ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:32.543395 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6380626a-5544-4c0d-ba01-456a6a9c09ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.543689 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6380626a-5544-4c0d-ba01-456a6a9c09ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.544512 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6380626a-5544-4c0d-ba01-456a6a9c09ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.545042 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6380626a-5544-4c0d-ba01-456a6a9c09ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.576833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-6380626a-5544-4c0d-ba01-456a6a9c09ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 May 10 03:19:32.577402 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 342/687] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:32 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:32.930620 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ef22ed95-f13d-450e-889f-14148c057fd8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:32.931335 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ef22ed95-f13d-450e-889f-14148c057fd8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:32.937135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef22ed95-f13d-450e-889f-14148c057fd8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.937589 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef22ed95-f13d-450e-889f-14148c057fd8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.938365 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef22ed95-f13d-450e-889f-14148c057fd8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.938836 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef22ed95-f13d-450e-889f-14148c057fd8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.024567 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ef22ed95-f13d-450e-889f-14148c057fd8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:33.032514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ef22ed95-f13d-450e-889f-14148c057fd8 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1479 microversion: 2.1 time: 0.106706 May 10 03:19:33.033186 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 346/688] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:32 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1479 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:33.038340 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-bdea64c6-ab1e-470e-8883-0c7f965227cc req-aaf4f085-96dc-4e5b-913d-a65a245523d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a709d3d8-e66d-4642-aee4-392801ae2f15", "name": "network-vif-deleted", "tag": "fd37adcc-6c61-4249-b29c-d3a717224790"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:33.046696 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-bdea64c6-ab1e-470e-8883-0c7f965227cc req-aaf4f085-96dc-4e5b-913d-a65a245523d9 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.047134 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-bdea64c6-ab1e-470e-8883-0c7f965227cc req-aaf4f085-96dc-4e5b-913d-a65a245523d9 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.058375 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-bdea64c6-ab1e-470e-8883-0c7f965227cc req-aaf4f085-96dc-4e5b-913d-a65a245523d9 service nova] Creating event network-vif-deleted:fd37adcc-6c61-4249-b29c-d3a717224790 for instance a709d3d8-e66d-4642-aee4-392801ae2f15 on hv-cinder-83009 May 10 03:19:33.063148 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-bdea64c6-ab1e-470e-8883-0c7f965227cc req-aaf4f085-96dc-4e5b-913d-a65a245523d9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028391 May 10 03:19:33.063725 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 343/689] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:33.433976 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:33.434599 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:33.440645 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.441124 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.441907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.442345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.500389 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1a9a87b0-3e00-4ef3-83dc-51664a0c8f68 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:33.501158 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1a9a87b0-3e00-4ef3-83dc-51664a0c8f68 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:33.507220 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1a9a87b0-3e00-4ef3-83dc-51664a0c8f68 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.507669 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1a9a87b0-3e00-4ef3-83dc-51664a0c8f68 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.508439 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1a9a87b0-3e00-4ef3-83dc-51664a0c8f68 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.508911 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1a9a87b0-3e00-4ef3-83dc-51664a0c8f68 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.573475 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:33.583700 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:33.585263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:33.587197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-423c16e8-4b91-4b09-b1da-8542996039b8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.157866 May 10 03:19:33.587775 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 347/690] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:33 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:33.592432 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ad057f52-085d-4d53-a705-51dd90d1ce0e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:33.593443 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ad057f52-085d-4d53-a705-51dd90d1ce0e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:33.599418 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ad057f52-085d-4d53-a705-51dd90d1ce0e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.599949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ad057f52-085d-4d53-a705-51dd90d1ce0e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.600798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ad057f52-085d-4d53-a705-51dd90d1ce0e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.601762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ad057f52-085d-4d53-a705-51dd90d1ce0e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.633990 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ad057f52-085d-4d53-a705-51dd90d1ce0e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 May 10 03:19:33.634584 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 348/691] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:33 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:33.645035 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1a9a87b0-3e00-4ef3-83dc-51664a0c8f68 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:33.652893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1a9a87b0-3e00-4ef3-83dc-51664a0c8f68 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1361 microversion: 2.1 time: 0.157143 May 10 03:19:33.653457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 344/692] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:33 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:34.049873 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:34.050482 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:34.056454 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.056933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.057702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.058130 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.089515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.089965 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.090407 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lazy-loading 'fault' on Instance uuid a709d3d8-e66d-4642-aee4-392801ae2f15 {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:34.129460 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dac5d7569d4402ca9c910ea8862b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2279255bed8483c82ba27a2451313fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.136825 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7237f5aa-7775-4615-9fe2-15cca1fd9e8f tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 200 len: 1311 microversion: 2.1 time: 0.090834 May 10 03:19:34.137400 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 349/693] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:34 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:34.608030 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:34.609641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:34.619953 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.620497 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.621757 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.622197 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.645470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6e64a667-d5ff-4b84-9cec-ab3fba4cf6d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:34.646390 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6e64a667-d5ff-4b84-9cec-ab3fba4cf6d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:34.652671 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6e64a667-d5ff-4b84-9cec-ab3fba4cf6d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.653130 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6e64a667-d5ff-4b84-9cec-ab3fba4cf6d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.653892 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6e64a667-d5ff-4b84-9cec-ab3fba4cf6d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.654321 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6e64a667-d5ff-4b84-9cec-ab3fba4cf6d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.685415 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6e64a667-d5ff-4b84-9cec-ab3fba4cf6d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 May 10 03:19:34.689050 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 350/694] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:34 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:34.690918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f725169a-86bf-4223-aeb2-dd25bcad284a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:34.691595 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f725169a-86bf-4223-aeb2-dd25bcad284a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:34.698257 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f725169a-86bf-4223-aeb2-dd25bcad284a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.698707 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f725169a-86bf-4223-aeb2-dd25bcad284a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.699474 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f725169a-86bf-4223-aeb2-dd25bcad284a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.699904 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f725169a-86bf-4223-aeb2-dd25bcad284a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.762969 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.770915 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.772837 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.774781 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5348920f-9c6a-4985-baa4-e9d4a5579a4a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.173111 May 10 03:19:34.775337 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 345/695] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:34 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:34.835301 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f725169a-86bf-4223-aeb2-dd25bcad284a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.842518 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f725169a-86bf-4223-aeb2-dd25bcad284a tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1546 microversion: 2.1 time: 0.155147 May 10 03:19:34.843073 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 351/696] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:34 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:34.858436 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d044d302-2f12-4b04-96e1-1839c4383978 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:34.858860 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d044d302-2f12-4b04-96e1-1839c4383978 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:34.864899 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d044d302-2f12-4b04-96e1-1839c4383978 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.865352 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d044d302-2f12-4b04-96e1-1839c4383978 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.866149 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d044d302-2f12-4b04-96e1-1839c4383978 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.866584 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d044d302-2f12-4b04-96e1-1839c4383978 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.942617 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d044d302-2f12-4b04-96e1-1839c4383978 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087895 May 10 03:19:34.943224 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 346/697] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 10 03:19:34 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:35.154762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:35.155694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] [instance: a709d3d8-e66d-4642-aee4-392801ae2f15] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:35.162066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.162521 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.163309 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.163762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.178391 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] HTTP exception thrown: Instance a709d3d8-e66d-4642-aee4-392801ae2f15 could not be found. May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Request method failure captured: May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 HTTP/1.1 May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediXoO1wImN1nMxT7K0VFnyk-ud7eOJBfMgvkNRRRr-cf-c1mcytsGc40j8U9iPKKpvhj7s4rxCFBuOPM9_AXH95peSeHP4-tgZcvutqW8yWliNsFkMABsaym8GaQSqonSfuSW4PejjvkQwy4uAy_wNtzWSflyQWwONBu9NEa0mM9bE May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: d2279255bed8483c82ba27a2451313fc May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:19:35.180146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d2279255bed8483c82ba27a2451313fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d2279255bed8483c82ba27a2451313fc", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d2279255bed8483c82ba27a2451313fc"}]}] May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: d2279255bed8483c82ba27a2451313fc May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1875262526 May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 6dac5d7569d4402ca9c910ea8862b5d9 May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1875262526-project May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance a709d3d8-e66d-4642-aee4-392801ae2f15 could not be found. May 10 03:19:35.181822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': 'a709d3d8-e66d-4642-aee4-392801ae2f15'} May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a709d3d8-e66d-4642-aee4-392801ae2f15 could not be found. May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:35.182580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a709d3d8-e66d-4642-aee4-392801ae2f15 could not be found. May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a709d3d8-e66d-4642-aee4-392801ae2f15 could not be found. May 10 03:19:35.184087 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:35.185662 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] Returning 404 to user: Instance a709d3d8-e66d-4642-aee4-392801ae2f15 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:35.185662 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-41ca2ac6-849c-48c5-bdbe-abf9c87da8f4 tempest-ServerRescueNegativeTestJSON-1875262526 tempest-ServerRescueNegativeTestJSON-1875262526-project] 10.222.0.55 "GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15" status: 404 len: 111 microversion: 2.1 time: 0.030767 May 10 03:19:35.185662 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 352/698] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:35 2022] GET /compute/v2.1/servers/a709d3d8-e66d-4642-aee4-392801ae2f15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:35.698592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-94ce5501-7f6a-4040-928a-20c269d1fe8e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:35.699706 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-94ce5501-7f6a-4040-928a-20c269d1fe8e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:35.706427 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-94ce5501-7f6a-4040-928a-20c269d1fe8e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.706881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-94ce5501-7f6a-4040-928a-20c269d1fe8e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.707663 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-94ce5501-7f6a-4040-928a-20c269d1fe8e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.708157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-94ce5501-7f6a-4040-928a-20c269d1fe8e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.746627 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-94ce5501-7f6a-4040-928a-20c269d1fe8e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054409 May 10 03:19:35.747210 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 347/699] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:19:35 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 03:19:35.794008 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:35.806272 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:35.806272 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.806272 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.806272 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.806655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.811236 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-74460124-c058-46c4-979e-0f07f86203d4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:35.811733 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-74460124-c058-46c4-979e-0f07f86203d4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:35.821305 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-74460124-c058-46c4-979e-0f07f86203d4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.821542 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-74460124-c058-46c4-979e-0f07f86203d4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.822314 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-74460124-c058-46c4-979e-0f07f86203d4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.822747 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-74460124-c058-46c4-979e-0f07f86203d4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.864337 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-74460124-c058-46c4-979e-0f07f86203d4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:19:35.979336 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-74460124-c058-46c4-979e-0f07f86203d4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 204 len: 0 microversion: 2.1 time: 0.171301 May 10 03:19:35.983333 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 348/700] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:19:35 2022] DELETE /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:19:35.989921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-19fd15dd-923b-48b6-b21f-1d1ece88c9d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:35.991070 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-19fd15dd-923b-48b6-b21f-1d1ece88c9d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:35.999276 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19fd15dd-923b-48b6-b21f-1d1ece88c9d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.999907 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19fd15dd-923b-48b6-b21f-1d1ece88c9d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.001342 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19fd15dd-923b-48b6-b21f-1d1ece88c9d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.002361 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19fd15dd-923b-48b6-b21f-1d1ece88c9d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.114784 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.125716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.127224 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.128411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b4980def-eb1b-41f2-9a56-516a231294fd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.339473 May 10 03:19:36.129017 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 353/701] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:35 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:36.144547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-687792db-3f52-4969-9a8c-decbe5dd7083 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:36.145196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-687792db-3f52-4969-9a8c-decbe5dd7083 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:36.152130 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-687792db-3f52-4969-9a8c-decbe5dd7083 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.152585 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-687792db-3f52-4969-9a8c-decbe5dd7083 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.153399 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-687792db-3f52-4969-9a8c-decbe5dd7083 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.153836 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-687792db-3f52-4969-9a8c-decbe5dd7083 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.219563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-19fd15dd-923b-48b6-b21f-1d1ece88c9d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.230914 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-19fd15dd-923b-48b6-b21f-1d1ece88c9d0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1679 microversion: 2.1 time: 0.246062 May 10 03:19:36.233555 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 349/702] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:35 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:36.415976 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-687792db-3f52-4969-9a8c-decbe5dd7083 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.430835 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-687792db-3f52-4969-9a8c-decbe5dd7083 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1596 microversion: 2.1 time: 0.288831 May 10 03:19:36.448286 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-0accee77-e662-4d0d-85d1-1c24a0e89ef7 req-96fb00fa-f74b-4306-8758-ab5818fb7cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3477a576-5f17-49ed-9b21-6fb4c6c52dd7", "tag": "fb909d63-5bc0-4574-995b-4f7117c39bab"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:36.453617 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 354/703] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:36 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1596 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:36.460058 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-0accee77-e662-4d0d-85d1-1c24a0e89ef7 req-96fb00fa-f74b-4306-8758-ab5818fb7cc1 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.460766 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-0accee77-e662-4d0d-85d1-1c24a0e89ef7 req-96fb00fa-f74b-4306-8758-ab5818fb7cc1 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.475794 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-0accee77-e662-4d0d-85d1-1c24a0e89ef7 req-96fb00fa-f74b-4306-8758-ab5818fb7cc1 service nova] Creating event network-changed:fb909d63-5bc0-4574-995b-4f7117c39bab for instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 on hv-cinder-83009 May 10 03:19:36.482622 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-0accee77-e662-4d0d-85d1-1c24a0e89ef7 req-96fb00fa-f74b-4306-8758-ab5818fb7cc1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111907 May 10 03:19:36.486589 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 350/704] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:37.147101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:37.148578 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:37.156254 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.157060 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.158100 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.158734 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.248758 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-82ec5849-e7c7-471f-92fd-36de77df1d30 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:37.250239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-82ec5849-e7c7-471f-92fd-36de77df1d30 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:37.259247 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-82ec5849-e7c7-471f-92fd-36de77df1d30 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.260016 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-82ec5849-e7c7-471f-92fd-36de77df1d30 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.261050 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-82ec5849-e7c7-471f-92fd-36de77df1d30 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.261773 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-82ec5849-e7c7-471f-92fd-36de77df1d30 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.404876 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.415454 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.416997 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.418480 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1005051f-ebde-4d57-be28-2c560e82e888 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.275343 May 10 03:19:37.428880 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 355/705] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:37 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:37.516809 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-82ec5849-e7c7-471f-92fd-36de77df1d30 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.531807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-82ec5849-e7c7-471f-92fd-36de77df1d30 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1679 microversion: 2.1 time: 0.286742 May 10 03:19:37.534219 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 351/706] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:37 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1679 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:38.436451 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:38.437408 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:38.443576 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.444097 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.445620 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.446303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.551272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9db46946-2e2f-45fd-98a0-26f549b17ff3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:38.551905 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9db46946-2e2f-45fd-98a0-26f549b17ff3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:38.558649 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9db46946-2e2f-45fd-98a0-26f549b17ff3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.559096 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9db46946-2e2f-45fd-98a0-26f549b17ff3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.560014 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9db46946-2e2f-45fd-98a0-26f549b17ff3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.560451 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9db46946-2e2f-45fd-98a0-26f549b17ff3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.801464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9db46946-2e2f-45fd-98a0-26f549b17ff3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:38.811258 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9db46946-2e2f-45fd-98a0-26f549b17ff3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1679 microversion: 2.1 time: 0.263663 May 10 03:19:38.821188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 352/707] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:38 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1679 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:38.821188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-31f1ba97-3f35-45a2-94bc-8bc43fbb90e4 req-0a07e882-aafc-4d3e-8a50-57eef59d3f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0144796a-ba13-4fb0-b9a6-ce953cbc7b60", "tag": "f02b6a99-10e5-411e-be0e-44e837772e46"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:38.827967 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-31f1ba97-3f35-45a2-94bc-8bc43fbb90e4 req-0a07e882-aafc-4d3e-8a50-57eef59d3f35 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.828416 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-31f1ba97-3f35-45a2-94bc-8bc43fbb90e4 req-0a07e882-aafc-4d3e-8a50-57eef59d3f35 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.839825 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-31f1ba97-3f35-45a2-94bc-8bc43fbb90e4 req-0a07e882-aafc-4d3e-8a50-57eef59d3f35 service nova] Creating event network-changed:f02b6a99-10e5-411e-be0e-44e837772e46 for instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 on hv-cinder-83009 May 10 03:19:38.845439 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-31f1ba97-3f35-45a2-94bc-8bc43fbb90e4 req-0a07e882-aafc-4d3e-8a50-57eef59d3f35 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031637 May 10 03:19:38.846597 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 353/708] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:38.913222 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:38.923040 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:38.925043 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:38.926624 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-485e8d62-3468-4403-800e-232b8bfcaa0e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.494136 May 10 03:19:38.942878 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 356/709] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:38 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:39.830777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-77ade82b-a43c-4c20-b816-8f7704f27f90 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:39.832916 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-77ade82b-a43c-4c20-b816-8f7704f27f90 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:39.843513 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-77ade82b-a43c-4c20-b816-8f7704f27f90 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.844830 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-77ade82b-a43c-4c20-b816-8f7704f27f90 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.846419 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-77ade82b-a43c-4c20-b816-8f7704f27f90 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.847018 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-77ade82b-a43c-4c20-b816-8f7704f27f90 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.943805 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-77ade82b-a43c-4c20-b816-8f7704f27f90 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:39.945611 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:39.946227 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:39.954416 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.954874 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.955655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.956084 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.963315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-77ade82b-a43c-4c20-b816-8f7704f27f90 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1612 microversion: 2.1 time: 0.137661 May 10 03:19:39.964912 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 354/710] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:39 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1612 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:40.374807 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.383630 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.385169 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.386380 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6c818156-77bd-40b7-bbe0-9ce307386079 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.445228 May 10 03:19:40.386949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 357/711] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:39 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:40.542605 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-4a2eb3d6-6067-4ce2-8092-103142eabab1 req-98164959-4325-46b8-8b65-dc58419abbfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972b595f-8244-44db-a40a-203044d9c20c", "name": "network-vif-deleted", "tag": "c3193703-1b47-452e-8101-fee2742e8e7a"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:40.560718 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-4a2eb3d6-6067-4ce2-8092-103142eabab1 req-98164959-4325-46b8-8b65-dc58419abbfa service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.561178 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-4a2eb3d6-6067-4ce2-8092-103142eabab1 req-98164959-4325-46b8-8b65-dc58419abbfa service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.596002 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-4a2eb3d6-6067-4ce2-8092-103142eabab1 req-98164959-4325-46b8-8b65-dc58419abbfa service nova] Creating event network-vif-deleted:c3193703-1b47-452e-8101-fee2742e8e7a for instance 972b595f-8244-44db-a40a-203044d9c20c on hv-cinder-83009 May 10 03:19:40.602199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-4a2eb3d6-6067-4ce2-8092-103142eabab1 req-98164959-4325-46b8-8b65-dc58419abbfa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064017 May 10 03:19:40.603146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 355/712] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:40.927243 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-39f7a06c-1620-4d6c-bb8f-666e583ff6bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1744991582"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:40.927775 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-39f7a06c-1620-4d6c-bb8f-666e583ff6bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:40.934569 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39f7a06c-1620-4d6c-bb8f-666e583ff6bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.935236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39f7a06c-1620-4d6c-bb8f-666e583ff6bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.936206 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39f7a06c-1620-4d6c-bb8f-666e583ff6bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.936818 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-39f7a06c-1620-4d6c-bb8f-666e583ff6bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.982198 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:40.983699 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:40.998266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.998725 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.999525 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.000198 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.043446 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.044148 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.052523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lazy-loading 'fault' on Instance uuid 972b595f-8244-44db-a40a-203044d9c20c {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:41.108968 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:41.117965 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-755b8a5b-6c18-4060-a30c-84fb03adfcd5 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 200 len: 1331 microversion: 2.1 time: 0.139656 May 10 03:19:41.118804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 356/713] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:40 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:41.274395 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.network.security_group_api [None req-39f7a06c-1620-4d6c-bb8f-666e583ff6bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Adding security group 2a5fe8a8-5cad-4baa-9d67-c7278c2e07fe to port f02b6a99-10e5-411e-be0e-44e837772e46 May 10 03:19:41.405738 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:41.406364 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:41.412609 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.413355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.414780 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.415227 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.570371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:41.578978 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:41.580493 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:41.581730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-bdb4a5f4-01a7-4171-b2b5-c9b576b52386 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.180391 May 10 03:19:41.582296 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 357/714] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:41 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:19:42.086656 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-39f7a06c-1620-4d6c-bb8f-666e583ff6bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "POST /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/action" status: 202 len: 0 microversion: 2.1 time: 1.163242 May 10 03:19:42.087274 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 358/715] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:19:40 2022] POST /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/action => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:19:42.096125 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-31f74cb9-b83e-48f0-a4a1-d805a24e238c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:42.096968 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-31f74cb9-b83e-48f0-a4a1-d805a24e238c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:42.112086 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31f74cb9-b83e-48f0-a4a1-d805a24e238c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.113366 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31f74cb9-b83e-48f0-a4a1-d805a24e238c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.114949 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31f74cb9-b83e-48f0-a4a1-d805a24e238c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.118083 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-31f74cb9-b83e-48f0-a4a1-d805a24e238c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.137871 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:42.138724 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:42.154619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.155628 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.156588 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.157206 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.210710 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c HTTP/1.1 May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:19:42.216168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:19:42.217679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '972b595f-8244-44db-a40a-203044d9c20c'} May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:42.218517 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:19:42.219737 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:19:42.229322 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:42.232959 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-390a6ed0-074d-4713-bc3f-a6995c3654a2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 404 len: 111 microversion: 2.1 time: 0.100589 May 10 03:19:42.237987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 359/716] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:42 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:42.251477 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-db1f10bd-c9d8-41ff-be9e-4f83606d09a3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '.version_select at 0x7f1497bf4160>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:42.283275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-db1f10bd-c9d8-41ff-be9e-4f83606d09a3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563066053" status: 202 len: 0 microversion: 2.1 time: 0.044079 May 10 03:19:42.283933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 360/717] 10.222.0.55 () {58 vars in 1220 bytes} [Tue May 10 03:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563066053 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:19:42.423810 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-31f74cb9-b83e-48f0-a4a1-d805a24e238c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:42.434984 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-31f74cb9-b83e-48f0-a4a1-d805a24e238c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1761 microversion: 2.1 time: 0.342506 May 10 03:19:42.436360 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 358/718] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:42 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1761 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:42.600509 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:42.602198 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:42.608715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.609451 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.610408 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.611007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.623702 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-134509e4-522a-4985-9596-c6e05ade0f69 req-17e432e9-e52f-4a01-bd5d-21ca06d8a9dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0144796a-ba13-4fb0-b9a6-ce953cbc7b60", "tag": "f02b6a99-10e5-411e-be0e-44e837772e46"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:42.651894 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-134509e4-522a-4985-9596-c6e05ade0f69 req-17e432e9-e52f-4a01-bd5d-21ca06d8a9dc service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.652635 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-134509e4-522a-4985-9596-c6e05ade0f69 req-17e432e9-e52f-4a01-bd5d-21ca06d8a9dc service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.669054 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-134509e4-522a-4985-9596-c6e05ade0f69 req-17e432e9-e52f-4a01-bd5d-21ca06d8a9dc service nova] Creating event network-changed:f02b6a99-10e5-411e-be0e-44e837772e46 for instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 on hv-cinder-83009 May 10 03:19:42.675183 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-134509e4-522a-4985-9596-c6e05ade0f69 req-17e432e9-e52f-4a01-bd5d-21ca06d8a9dc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055454 May 10 03:19:42.676388 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 359/719] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:42.855292 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:42.870089 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:42.873827 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:42.875986 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-039f14e0-b258-4290-b745-bb924524af8a tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.278546 May 10 03:19:42.877939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 361/720] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:42 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:43.037465 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8969256d-b47e-4b8b-85a1-e420823732ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: .version_select at 0x7f14a4605040>, body: {"keypair": {"name": "tempest-keypair-320499404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBbJEgXqoox9jMBcdvteUb1su73ECvVpevhSyXraaQfuVljlU6R+ug51ovZYebWxA71tx7y7cbRXZLidowuzoInLd+qWhzGxFzwPZLbm66MEv2+cG3ysUmQXsunKg3SNg=="}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:43.055764 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-8969256d-b47e-4b8b-85a1-e420823732ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:43.065798 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-8969256d-b47e-4b8b-85a1-e420823732ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for user 775d3d61ab8d42c3a528028592ad71f8 and project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:43.100452 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8969256d-b47e-4b8b-85a1-e420823732ed tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067555 May 10 03:19:43.107164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 360/721] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:19:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:43.894679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:43.895429 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:43.904009 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.904552 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.905626 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.906272 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.138159 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.148474 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.151604 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.151604 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4620bf93-183e-4260-ac12-82b2209257c0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1743 microversion: 2.20 time: 0.260957 May 10 03:19:44.164146 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 362/722] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:43 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:44.529896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-455939582", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20b0c49b-98e0-4d73-bdea-8b46faafc116"}], "security_groups": [{"name": "tempest-securitygroup--768546891"}], "key_name": "tempest-keypair-320499404", "user_data": "}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:44.628501 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] validate_networks() for [('20b0c49b-98e0-4d73-bdea-8b46faafc116', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:19:45.111837 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:19:45.112256 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:19:45.112752 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:19:45.113159 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:19:45.113560 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:19:45.122666 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.123125 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.123936 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.124371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.146344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:45.151466 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Getting quotas for user 775d3d61ab8d42c3a528028592ad71f8 and project 5a2376b2c653467b885e8f3deb5018e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:45.168570 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:19:45.171635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:45.173601 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:45.174631 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:19:45.181000 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.181728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.182698 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.183835 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.236087 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e003d23c-caba-45a1-9f9d-e6bcc65416bb tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.710872 May 10 03:19:45.237496 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 361/723] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:19:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:19:45.250339 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c896e8e2-125d-4440-a28b-41b52c7098e8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:45.251379 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-c896e8e2-125d-4440-a28b-41b52c7098e8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:45.325185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-c896e8e2-125d-4440-a28b-41b52c7098e8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:45.341627 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c896e8e2-125d-4440-a28b-41b52c7098e8 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1240 microversion: 2.1 time: 0.095463 May 10 03:19:45.342841 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 362/724] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:45 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:45.483147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:45.494760 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:45.497099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:45.498673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-48a08b89-4d00-4639-ba2e-1028bae46864 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1738 microversion: 2.20 time: 0.331261 May 10 03:19:45.499924 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 363/725] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:45 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:19:46.358827 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-04c4f1a9-e40e-47d0-8240-9869d82a0773 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:46.360708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-04c4f1a9-e40e-47d0-8240-9869d82a0773 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:46.368609 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-04c4f1a9-e40e-47d0-8240-9869d82a0773 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.369397 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-04c4f1a9-e40e-47d0-8240-9869d82a0773 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.370672 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-04c4f1a9-e40e-47d0-8240-9869d82a0773 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.371483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-04c4f1a9-e40e-47d0-8240-9869d82a0773 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.481508 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-04c4f1a9-e40e-47d0-8240-9869d82a0773 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.494309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-04c4f1a9-e40e-47d0-8240-9869d82a0773 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1300 microversion: 2.1 time: 0.139586 May 10 03:19:46.505681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 363/726] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:46 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:46.519363 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:46.526770 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:46.539061 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.539924 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.541032 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.541758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.830745 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.846533 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.852472 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.857410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-01a9b5a8-49c9-413e-ba36-3e8e4025144b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1738 microversion: 2.20 time: 0.342229 May 10 03:19:46.860509 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 364/727] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:46 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1738 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:19:47.515075 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-70b2c79d-5fae-4f82-b397-045041295f89 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:47.516307 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-70b2c79d-5fae-4f82-b397-045041295f89 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:47.523683 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-70b2c79d-5fae-4f82-b397-045041295f89 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.524523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-70b2c79d-5fae-4f82-b397-045041295f89 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.525522 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-70b2c79d-5fae-4f82-b397-045041295f89 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.525943 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-70b2c79d-5fae-4f82-b397-045041295f89 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.743306 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-70b2c79d-5fae-4f82-b397-045041295f89 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:47.754780 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-70b2c79d-5fae-4f82-b397-045041295f89 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1365 microversion: 2.1 time: 0.246362 May 10 03:19:47.755983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 364/728] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:47 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:47.878358 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:47.879070 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:47.890546 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.893406 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.894243 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.894784 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.216108 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.253556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.255601 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.257638 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-846c56d2-63b2-470b-80a6-55380347b35e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1738 microversion: 2.20 time: 0.383271 May 10 03:19:48.259111 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 365/729] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:47 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:48.498533 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-ff99c9cd-ae94-4ba3-a066-f35f2e0b88bd req-01b2379c-07ac-482e-b786-9f1fe35a0789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab", "name": "network-vif-plugged", "status": "completed", "tag": "8849e2ad-b7bd-40d0-aba9-d512831c8b63"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:48.515371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-ff99c9cd-ae94-4ba3-a066-f35f2e0b88bd req-01b2379c-07ac-482e-b786-9f1fe35a0789 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.516557 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-ff99c9cd-ae94-4ba3-a066-f35f2e0b88bd req-01b2379c-07ac-482e-b786-9f1fe35a0789 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.535762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-9ee20bca-9711-46ed-b935-af3e1961d99d req-b954f877-c359-4911-a1a0-faadba2b8a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d16034-b3aa-45db-82ac-5151dfb9eed6", "tag": "0607fff6-66e9-4d7d-ac75-7c3731cd5c53"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:48.545090 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-ff99c9cd-ae94-4ba3-a066-f35f2e0b88bd req-01b2379c-07ac-482e-b786-9f1fe35a0789 service nova] Creating event network-vif-plugged:8849e2ad-b7bd-40d0-aba9-d512831c8b63 for instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab on hv-cinder-83009 May 10 03:19:48.553133 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-ff99c9cd-ae94-4ba3-a066-f35f2e0b88bd req-01b2379c-07ac-482e-b786-9f1fe35a0789 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243806 May 10 03:19:48.554756 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 365/730] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:48.559014 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-9ee20bca-9711-46ed-b935-af3e1961d99d req-b954f877-c359-4911-a1a0-faadba2b8a68 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.559486 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-9ee20bca-9711-46ed-b935-af3e1961d99d req-b954f877-c359-4911-a1a0-faadba2b8a68 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.583706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-9ee20bca-9711-46ed-b935-af3e1961d99d req-b954f877-c359-4911-a1a0-faadba2b8a68 service nova] Creating event network-changed:0607fff6-66e9-4d7d-ac75-7c3731cd5c53 for instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 on hv-cinder-83009 May 10 03:19:48.592033 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-9ee20bca-9711-46ed-b935-af3e1961d99d req-b954f877-c359-4911-a1a0-faadba2b8a68 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059858 May 10 03:19:48.593252 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 366/731] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:48.776146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-91bf89ff-baec-4197-8abf-2d6058a2c9d1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:48.776979 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-91bf89ff-baec-4197-8abf-2d6058a2c9d1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:48.810994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-91bf89ff-baec-4197-8abf-2d6058a2c9d1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.810994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-91bf89ff-baec-4197-8abf-2d6058a2c9d1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.811891 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-91bf89ff-baec-4197-8abf-2d6058a2c9d1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.812399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-91bf89ff-baec-4197-8abf-2d6058a2c9d1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.977676 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-91bf89ff-baec-4197-8abf-2d6058a2c9d1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.988244 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-91bf89ff-baec-4197-8abf-2d6058a2c9d1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1365 microversion: 2.1 time: 0.218327 May 10 03:19:48.989045 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 366/732] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:48 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:49.277909 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:49.279465 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:49.287200 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.287746 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.289547 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.289996 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.437560 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:49.446747 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:49.448255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:49.450437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5bd9fb10-cd68-4de8-abce-cd0dc824fec3 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1738 microversion: 2.20 time: 0.177160 May 10 03:19:49.452686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 367/733] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:49 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:50.007369 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0214d154-8ee3-4084-9cd9-e7393f4c690f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:50.008063 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0214d154-8ee3-4084-9cd9-e7393f4c690f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:50.015281 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0214d154-8ee3-4084-9cd9-e7393f4c690f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.016972 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0214d154-8ee3-4084-9cd9-e7393f4c690f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.017999 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0214d154-8ee3-4084-9cd9-e7393f4c690f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.018662 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0214d154-8ee3-4084-9cd9-e7393f4c690f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.180915 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0214d154-8ee3-4084-9cd9-e7393f4c690f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.189200 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0214d154-8ee3-4084-9cd9-e7393f4c690f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1365 microversion: 2.1 time: 0.185573 May 10 03:19:50.190108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 367/734] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:50 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:50.471599 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:50.472260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:50.479094 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.479542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.480458 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.480912 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.706094 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.721108 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.723240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.724728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-48d5707b-ab5a-4eaa-8859-0af5ad445506 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1738 microversion: 2.20 time: 0.257321 May 10 03:19:50.739520 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 368/735] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:50 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:51.206196 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-6783589a-48b5-4097-a9b3-8a99d4fbce36 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:51.206806 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-6783589a-48b5-4097-a9b3-8a99d4fbce36 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:51.214360 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6783589a-48b5-4097-a9b3-8a99d4fbce36 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.214989 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6783589a-48b5-4097-a9b3-8a99d4fbce36 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.216006 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6783589a-48b5-4097-a9b3-8a99d4fbce36 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.216989 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6783589a-48b5-4097-a9b3-8a99d4fbce36 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.376120 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-6783589a-48b5-4097-a9b3-8a99d4fbce36 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.384509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-6783589a-48b5-4097-a9b3-8a99d4fbce36 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1365 microversion: 2.1 time: 0.182161 May 10 03:19:51.386030 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 368/736] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:51 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:51.756282 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:51.757479 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:51.768604 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.769167 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.769958 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.770392 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.936004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.947930 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.949389 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.950583 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1dac831f-03c7-4b02-9f0f-df98310aeac8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1738 microversion: 2.20 time: 0.207158 May 10 03:19:51.961367 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 369/737] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:51 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:52.404420 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-35518b95-fdec-4ea8-8423-38d57b665de9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:52.405082 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-35518b95-fdec-4ea8-8423-38d57b665de9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:52.411966 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-35518b95-fdec-4ea8-8423-38d57b665de9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.412339 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-35518b95-fdec-4ea8-8423-38d57b665de9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.416224 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-35518b95-fdec-4ea8-8423-38d57b665de9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.416753 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-35518b95-fdec-4ea8-8423-38d57b665de9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.585500 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-35518b95-fdec-4ea8-8423-38d57b665de9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:52.593463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-35518b95-fdec-4ea8-8423-38d57b665de9 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1365 microversion: 2.1 time: 0.192922 May 10 03:19:52.594627 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 369/738] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:52 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:52.979330 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:52.979974 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:52.987420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.987839 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.988632 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.989097 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.172078 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:53.182387 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:53.185817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:53.187213 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b7d18784-9445-4ee5-bc1c-fe0352078c3b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1738 microversion: 2.20 time: 0.213869 May 10 03:19:53.190974 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 370/739] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:52 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:53.611702 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8d3bb8d9-407a-438d-bbab-965988614dea tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:53.612244 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8d3bb8d9-407a-438d-bbab-965988614dea tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:53.622682 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d3bb8d9-407a-438d-bbab-965988614dea tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.623463 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d3bb8d9-407a-438d-bbab-965988614dea tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.624457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d3bb8d9-407a-438d-bbab-965988614dea tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.625111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8d3bb8d9-407a-438d-bbab-965988614dea tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.784986 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8d3bb8d9-407a-438d-bbab-965988614dea tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:53.793655 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8d3bb8d9-407a-438d-bbab-965988614dea tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1365 microversion: 2.1 time: 0.185879 May 10 03:19:53.802994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 370/740] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:53 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:54.209463 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:54.211334 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:54.218677 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.219403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.220189 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.220828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.249504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-b90e662c-1169-487e-84b6-91492422d731 req-0b4e756a-e8db-47b2-a626-5fae5c90c08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d16034-b3aa-45db-82ac-5151dfb9eed6", "name": "network-vif-plugged", "status": "completed", "tag": "0607fff6-66e9-4d7d-ac75-7c3731cd5c53"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:54.268590 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-b90e662c-1169-487e-84b6-91492422d731 req-0b4e756a-e8db-47b2-a626-5fae5c90c08f service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.269202 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-b90e662c-1169-487e-84b6-91492422d731 req-0b4e756a-e8db-47b2-a626-5fae5c90c08f service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.284299 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-b90e662c-1169-487e-84b6-91492422d731 req-0b4e756a-e8db-47b2-a626-5fae5c90c08f service nova] Creating event network-vif-plugged:0607fff6-66e9-4d7d-ac75-7c3731cd5c53 for instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 on hv-cinder-83009 May 10 03:19:54.292116 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-b90e662c-1169-487e-84b6-91492422d731 req-0b4e756a-e8db-47b2-a626-5fae5c90c08f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046127 May 10 03:19:54.293417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 371/741] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:54.424615 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:54.434913 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:54.437083 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:54.438623 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a7a09952-96ec-4088-bb80-d622a3e38c09 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1738 microversion: 2.20 time: 0.234368 May 10 03:19:54.439722 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 371/742] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:54 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:54.812117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-40d81b2f-8016-4f91-a36d-7dfd27de46a4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:54.812960 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-40d81b2f-8016-4f91-a36d-7dfd27de46a4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:54.821494 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-40d81b2f-8016-4f91-a36d-7dfd27de46a4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.822515 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-40d81b2f-8016-4f91-a36d-7dfd27de46a4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.825086 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-40d81b2f-8016-4f91-a36d-7dfd27de46a4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.826983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-40d81b2f-8016-4f91-a36d-7dfd27de46a4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.019119 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-40d81b2f-8016-4f91-a36d-7dfd27de46a4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:55.027086 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-40d81b2f-8016-4f91-a36d-7dfd27de46a4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1365 microversion: 2.1 time: 0.219816 May 10 03:19:55.027671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 372/743] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:54 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:55.457548 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:55.458147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:55.465057 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.465505 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.466258 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.466683 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.596481 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:55.605345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:55.606853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:55.608016 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-de82de2d-fbf2-47ea-9b39-610ef5677673 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1738 microversion: 2.20 time: 0.154517 May 10 03:19:55.608591 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 372/744] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:55 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:56.044117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f9fb37f4-45fb-4de6-8194-83fa2db37596 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:56.044889 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f9fb37f4-45fb-4de6-8194-83fa2db37596 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:56.051856 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f9fb37f4-45fb-4de6-8194-83fa2db37596 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:56.052309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f9fb37f4-45fb-4de6-8194-83fa2db37596 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:56.053340 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f9fb37f4-45fb-4de6-8194-83fa2db37596 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:56.054136 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f9fb37f4-45fb-4de6-8194-83fa2db37596 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:56.202588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f9fb37f4-45fb-4de6-8194-83fa2db37596 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:56.210492 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f9fb37f4-45fb-4de6-8194-83fa2db37596 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1553 microversion: 2.1 time: 0.170760 May 10 03:19:56.211152 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 373/745] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:19:56 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:56.228026 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-233f4479-d4e6-4e87-ad34-4e9255921b9d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:56.228523 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-233f4479-d4e6-4e87-ad34-4e9255921b9d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:56.235185 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-233f4479-d4e6-4e87-ad34-4e9255921b9d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:56.235640 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-233f4479-d4e6-4e87-ad34-4e9255921b9d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:56.236421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-233f4479-d4e6-4e87-ad34-4e9255921b9d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:56.236883 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-233f4479-d4e6-4e87-ad34-4e9255921b9d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:56.313548 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-233f4479-d4e6-4e87-ad34-4e9255921b9d tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090201 May 10 03:19:56.314180 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 373/746] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 10 03:19:56 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:56.626498 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:56.627205 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:56.633420 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:56.633864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:56.634621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:56.635051 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:56.763164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:56.771014 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:56.773153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:56.774336 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2e626a38-c2a7-470b-a400-61939ed9974c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1720 microversion: 2.20 time: 0.151707 May 10 03:19:56.774908 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 374/747] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:56 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:57.793233 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:57.793806 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:57.799643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:57.800090 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:57.800889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:57.801322 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:57.991550 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:57.999592 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:58.001118 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:58.002704 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-919401da-de51-488c-89f7-981431cb82d0 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1720 microversion: 2.20 time: 0.213397 May 10 03:19:58.013510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 374/748] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:57 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:58.024581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-1ef2c6d3-e062-42ca-978f-6a40a9133a8f req-624c7140-a2ed-4e72-a4d0-27ea9335b613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d16034-b3aa-45db-82ac-5151dfb9eed6", "tag": "0607fff6-66e9-4d7d-ac75-7c3731cd5c53"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:58.032777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-1ef2c6d3-e062-42ca-978f-6a40a9133a8f req-624c7140-a2ed-4e72-a4d0-27ea9335b613 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:58.033232 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-1ef2c6d3-e062-42ca-978f-6a40a9133a8f req-624c7140-a2ed-4e72-a4d0-27ea9335b613 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:58.044203 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-1ef2c6d3-e062-42ca-978f-6a40a9133a8f req-624c7140-a2ed-4e72-a4d0-27ea9335b613 service nova] Creating event network-changed:0607fff6-66e9-4d7d-ac75-7c3731cd5c53 for instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 on hv-cinder-83009 May 10 03:19:58.051836 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-1ef2c6d3-e062-42ca-978f-6a40a9133a8f req-624c7140-a2ed-4e72-a4d0-27ea9335b613 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088746 May 10 03:19:58.052445 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 375/749] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:59.020721 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:59.021341 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:59.028350 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:59.028838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:59.029605 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:59.030041 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:59.160851 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:59.169477 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:59.170979 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:59.172153 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-eff05f69-3e97-45a8-812e-1b9dc73df6f7 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1720 microversion: 2.20 time: 0.155468 May 10 03:19:59.172765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 375/750] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:19:59 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:00.191952 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-25d7b34c-aeaa-4531-b640-ecca6bd96ec2 req-3c0036e7-29d3-4b48-bdcb-3d1cc92bc62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab", "name": "network-vif-unplugged", "status": "completed", "tag": "8849e2ad-b7bd-40d0-aba9-d512831c8b63"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:00.192503 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:00.193270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:00.200502 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.201109 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.202100 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.202725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.209301 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-25d7b34c-aeaa-4531-b640-ecca6bd96ec2 req-3c0036e7-29d3-4b48-bdcb-3d1cc92bc62b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.211602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-25d7b34c-aeaa-4531-b640-ecca6bd96ec2 req-3c0036e7-29d3-4b48-bdcb-3d1cc92bc62b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.230558 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.compute.server_external_events [req-25d7b34c-aeaa-4531-b640-ecca6bd96ec2 req-3c0036e7-29d3-4b48-bdcb-3d1cc92bc62b service nova] Unable to find a host for instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab. Dropping event network-vif-unplugged {{(pid=117119) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 03:20:00.231651 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-25d7b34c-aeaa-4531-b640-ecca6bd96ec2 req-3c0036e7-29d3-4b48-bdcb-3d1cc92bc62b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048506 May 10 03:20:00.232699 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 376/751] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 03:20:00.343631 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:00.351988 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:00.353518 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:00.354678 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-38f40723-b1d0-47dc-9976-45844dbf6441 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1663 microversion: 2.20 time: 0.166316 May 10 03:20:00.355243 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 376/752] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:00 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:20:00.372298 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2ac96ed7-43ca-49f5-a426-d772d2871c6f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c09f659-864c-4af7-a0a9-c245e3142da3"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:00.373508 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2ac96ed7-43ca-49f5-a426-d772d2871c6f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:00.379391 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ac96ed7-43ca-49f5-a426-d772d2871c6f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.379836 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ac96ed7-43ca-49f5-a426-d772d2871c6f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.380590 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ac96ed7-43ca-49f5-a426-d772d2871c6f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.381046 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2ac96ed7-43ca-49f5-a426-d772d2871c6f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.665040 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2ac96ed7-43ca-49f5-a426-d772d2871c6f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296294 May 10 03:20:00.665665 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 377/753] 10.222.0.55 () {62 vars in 1363 bytes} [Tue May 10 03:20:00 2022] POST /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:20:00.780367 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8d335f73-3034-4286-9091-c91702c16666 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:00.780877 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8d335f73-3034-4286-9091-c91702c16666 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:00.786691 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8d335f73-3034-4286-9091-c91702c16666 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.787137 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8d335f73-3034-4286-9091-c91702c16666 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.788103 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8d335f73-3034-4286-9091-c91702c16666 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.788531 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8d335f73-3034-4286-9091-c91702c16666 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.017808 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8d335f73-3034-4286-9091-c91702c16666 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "DELETE /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/os-volume_attachments/1c09f659-864c-4af7-a0a9-c245e3142da3" status: 202 len: 0 microversion: 2.20 time: 0.241556 May 10 03:20:01.018412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 377/754] 10.222.0.55 () {60 vars in 1456 bytes} [Tue May 10 03:20:00 2022] DELETE /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/os-volume_attachments/1c09f659-864c-4af7-a0a9-c245e3142da3 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:20:01.077613 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7d38c8cf-b18a-4a9a-8569-13680e81bbca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:01.078236 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7d38c8cf-b18a-4a9a-8569-13680e81bbca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:01.085709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d38c8cf-b18a-4a9a-8569-13680e81bbca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.086162 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d38c8cf-b18a-4a9a-8569-13680e81bbca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.086937 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d38c8cf-b18a-4a9a-8569-13680e81bbca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.087372 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7d38c8cf-b18a-4a9a-8569-13680e81bbca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.180139 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7d38c8cf-b18a-4a9a-8569-13680e81bbca tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "POST /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/action" status: 202 len: 0 microversion: 2.20 time: 0.106400 May 10 03:20:01.180770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 378/755] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 10 03:20:01 2022] POST /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:20:01.189027 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:01.189637 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:01.197139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.198230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.199007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.199435 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.339330 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:01.354136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:01.356086 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:01.357462 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e4b219e4-af36-40da-a1cc-5df4b8f32541 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1671 microversion: 2.20 time: 0.172139 May 10 03:20:01.358460 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 378/756] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:01 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:01.972766 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9aa10627-fb2e-4de0-bcde-e39538c198bb tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:01.973765 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9aa10627-fb2e-4de0-bcde-e39538c198bb tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:01.981707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9aa10627-fb2e-4de0-bcde-e39538c198bb tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.982164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9aa10627-fb2e-4de0-bcde-e39538c198bb tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.982930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9aa10627-fb2e-4de0-bcde-e39538c198bb tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.983367 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9aa10627-fb2e-4de0-bcde-e39538c198bb tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.060006 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9aa10627-fb2e-4de0-bcde-e39538c198bb tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "POST /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/action" status: 202 len: 0 microversion: 2.1 time: 0.091356 May 10 03:20:02.060726 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 379/757] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:20:01 2022] POST /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:20:02.068594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-60be6d06-cda6-4b1a-b234-42571a699cef tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:02.074224 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-60be6d06-cda6-4b1a-b234-42571a699cef tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:02.085215 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-60be6d06-cda6-4b1a-b234-42571a699cef tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.085769 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-60be6d06-cda6-4b1a-b234-42571a699cef tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.086622 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-60be6d06-cda6-4b1a-b234-42571a699cef tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.087125 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-60be6d06-cda6-4b1a-b234-42571a699cef tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.357241 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-60be6d06-cda6-4b1a-b234-42571a699cef tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:02.366580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-60be6d06-cda6-4b1a-b234-42571a699cef tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1753 microversion: 2.1 time: 0.301634 May 10 03:20:02.367170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 379/758] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:02 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1753 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:02.377460 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:02.378563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:02.386389 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.386913 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.387942 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.389231 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.558867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:02.570299 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:02.572257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:02.573723 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1db04064-44a6-417d-b507-dc4598629acc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1671 microversion: 2.20 time: 0.201150 May 10 03:20:02.575208 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 380/759] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:02 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:03.383509 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0c9619f3-32e7-4a3e-82c4-e616f76d25dd tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:03.384136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0c9619f3-32e7-4a3e-82c4-e616f76d25dd tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:03.390926 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0c9619f3-32e7-4a3e-82c4-e616f76d25dd tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.391373 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0c9619f3-32e7-4a3e-82c4-e616f76d25dd tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.392172 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0c9619f3-32e7-4a3e-82c4-e616f76d25dd tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.392608 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0c9619f3-32e7-4a3e-82c4-e616f76d25dd tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.592577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:03.593216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:03.599513 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.600536 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.601546 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.601987 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.613764 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0c9619f3-32e7-4a3e-82c4-e616f76d25dd tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:03.623118 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0c9619f3-32e7-4a3e-82c4-e616f76d25dd tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.243633 May 10 03:20:03.623713 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 380/760] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:03 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:03.745961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:03.753722 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:03.755233 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:03.757099 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-17255314-c8cd-456f-93df-a22de4f9dbdd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.167716 May 10 03:20:03.757642 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 381/761] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:03 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:20:04.641771 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dc85ec2e-5169-4ee8-9651-3a890cdc513e tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:04.642401 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-dc85ec2e-5169-4ee8-9651-3a890cdc513e tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:04.651625 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc85ec2e-5169-4ee8-9651-3a890cdc513e tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:04.652274 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc85ec2e-5169-4ee8-9651-3a890cdc513e tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:04.653626 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc85ec2e-5169-4ee8-9651-3a890cdc513e tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:04.654209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dc85ec2e-5169-4ee8-9651-3a890cdc513e tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:04.777519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:04.778230 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:04.792843 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:04.793269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:04.794243 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:04.794867 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:04.888184 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-dc85ec2e-5169-4ee8-9651-3a890cdc513e tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:04.900374 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-dc85ec2e-5169-4ee8-9651-3a890cdc513e tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.262513 May 10 03:20:04.901159 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 381/762] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:04 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:04.971340 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:04.980266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:04.981803 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:04.982977 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c9991b3d-45df-4bc5-99f5-1ab23b23866b tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.209594 May 10 03:20:04.983554 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 382/763] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:04 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:05.918483 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d4ca6928-1cfa-444b-80d3-568bde3bba47 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:05.919777 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d4ca6928-1cfa-444b-80d3-568bde3bba47 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:05.930656 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4ca6928-1cfa-444b-80d3-568bde3bba47 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:05.930989 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4ca6928-1cfa-444b-80d3-568bde3bba47 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:05.931895 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4ca6928-1cfa-444b-80d3-568bde3bba47 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:05.932381 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d4ca6928-1cfa-444b-80d3-568bde3bba47 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:06.001590 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:06.002971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:06.010293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:06.011094 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:06.012384 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:06.013123 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:06.188808 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:06.192086 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d4ca6928-1cfa-444b-80d3-568bde3bba47 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:06.206993 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d4ca6928-1cfa-444b-80d3-568bde3bba47 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.292266 May 10 03:20:06.210119 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:06.210736 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 382/764] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:05 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:06.212470 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:06.214093 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ef18fb77-1001-4684-80b7-bdc9d0c8b52e tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.216409 May 10 03:20:06.215377 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 383/765] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:05 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:20:07.224516 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cf6f57d0-4371-4562-a092-fa928d312586 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:07.225586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-cf6f57d0-4371-4562-a092-fa928d312586 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:07.232833 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cf6f57d0-4371-4562-a092-fa928d312586 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:07.233602 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cf6f57d0-4371-4562-a092-fa928d312586 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:07.234609 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cf6f57d0-4371-4562-a092-fa928d312586 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:07.235166 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:07.235665 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-cf6f57d0-4371-4562-a092-fa928d312586 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:07.235787 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:07.242682 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:07.243135 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:07.243930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:07.244367 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:07.402415 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-cf6f57d0-4371-4562-a092-fa928d312586 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:07.411107 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-cf6f57d0-4371-4562-a092-fa928d312586 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.190358 May 10 03:20:07.411693 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 383/766] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:07 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:07.449601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:07.457303 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:07.458795 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:07.460580 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1306e310-8e65-448b-baa4-1b5d28870229 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.229233 May 10 03:20:07.461165 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 384/767] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:07 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:20:08.430061 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b37bfb6d-ba9b-4462-8e59-eb16dd25b4bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:08.430676 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b37bfb6d-ba9b-4462-8e59-eb16dd25b4bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:08.437039 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b37bfb6d-ba9b-4462-8e59-eb16dd25b4bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:08.437489 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b37bfb6d-ba9b-4462-8e59-eb16dd25b4bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:08.438268 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b37bfb6d-ba9b-4462-8e59-eb16dd25b4bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:08.438701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b37bfb6d-ba9b-4462-8e59-eb16dd25b4bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:08.477621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:08.479342 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:08.490299 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:08.491681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:08.492720 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:08.493467 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:08.633843 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b37bfb6d-ba9b-4462-8e59-eb16dd25b4bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:08.644175 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:08.648006 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b37bfb6d-ba9b-4462-8e59-eb16dd25b4bf tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.222955 May 10 03:20:08.648757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 384/768] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:08 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:08.657757 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:08.659255 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:08.660431 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e37ff6a1-407c-4a95-a1e5-3f26607b2f88 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.186821 May 10 03:20:08.661025 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 385/769] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:08 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:20:09.666492 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c9157352-54ba-4f9f-8611-6169eabf8a9c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:09.667103 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c9157352-54ba-4f9f-8611-6169eabf8a9c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:09.673996 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c9157352-54ba-4f9f-8611-6169eabf8a9c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:09.674435 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c9157352-54ba-4f9f-8611-6169eabf8a9c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:09.675406 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c9157352-54ba-4f9f-8611-6169eabf8a9c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:09.676060 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c9157352-54ba-4f9f-8611-6169eabf8a9c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:09.679426 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:09.680056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:09.686431 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:09.686882 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:09.692813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:09.693300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:09.869280 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:09.873577 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c9157352-54ba-4f9f-8611-6169eabf8a9c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:09.881607 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:09.885971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:09.885971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-37cdd4f0-53bc-4535-94ed-f3bae63b1f24 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.210136 May 10 03:20:09.898343 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 386/770] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:09 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:09.903099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c9157352-54ba-4f9f-8611-6169eabf8a9c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.220946 May 10 03:20:09.903847 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 385/771] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:09 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:10.904449 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:10.905538 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:10.912297 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.913278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:10.914057 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.914509 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:10.921123 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-708efaa7-94e9-4809-a204-8c1d549c1462 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:10.922009 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-708efaa7-94e9-4809-a204-8c1d549c1462 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:10.929730 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-708efaa7-94e9-4809-a204-8c1d549c1462 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.930485 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-708efaa7-94e9-4809-a204-8c1d549c1462 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:10.931498 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-708efaa7-94e9-4809-a204-8c1d549c1462 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.932332 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-708efaa7-94e9-4809-a204-8c1d549c1462 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:11.131577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:11.143784 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:11.146338 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:11.149047 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-91943c46-b239-42e1-bd9b-21273a86a145 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.248514 May 10 03:20:11.161339 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 387/772] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:10 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:11.184329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-708efaa7-94e9-4809-a204-8c1d549c1462 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:11.196952 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-708efaa7-94e9-4809-a204-8c1d549c1462 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.279958 May 10 03:20:11.197531 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 386/773] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:10 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:12.168034 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:12.168790 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:12.174680 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:12.175126 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:12.175891 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:12.176322 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:12.215006 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3e31fa0d-b632-4ac2-bcff-3c5fb52ace2d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:12.215619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3e31fa0d-b632-4ac2-bcff-3c5fb52ace2d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:12.222273 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3e31fa0d-b632-4ac2-bcff-3c5fb52ace2d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:12.222940 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3e31fa0d-b632-4ac2-bcff-3c5fb52ace2d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:12.223728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3e31fa0d-b632-4ac2-bcff-3c5fb52ace2d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:12.224167 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3e31fa0d-b632-4ac2-bcff-3c5fb52ace2d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:12.351727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:12.360100 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:12.361849 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:12.363746 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-84c94702-4c2f-4c94-b01b-5e7dd59de045 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.199555 May 10 03:20:12.364471 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 388/774] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:12 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:12.393231 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3e31fa0d-b632-4ac2-bcff-3c5fb52ace2d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:12.406115 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3e31fa0d-b632-4ac2-bcff-3c5fb52ace2d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.194818 May 10 03:20:12.407090 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 387/775] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:12 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:13.384774 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:13.385516 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:13.391838 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:13.392291 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:13.393093 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:13.393534 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:13.424457 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7ccff60f-4c36-45b2-a64b-91b9d4f3e638 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:13.425242 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7ccff60f-4c36-45b2-a64b-91b9d4f3e638 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:13.432533 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7ccff60f-4c36-45b2-a64b-91b9d4f3e638 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:13.433033 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7ccff60f-4c36-45b2-a64b-91b9d4f3e638 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:13.433814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7ccff60f-4c36-45b2-a64b-91b9d4f3e638 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:13.434253 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7ccff60f-4c36-45b2-a64b-91b9d4f3e638 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:13.526629 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:13.534630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:13.536148 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:13.537430 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-15cced67-13fe-4c8b-b98b-c34c723e0723 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.157792 May 10 03:20:13.538053 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 389/776] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:13 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:13.577696 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-7ccff60f-4c36-45b2-a64b-91b9d4f3e638 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:13.585613 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7ccff60f-4c36-45b2-a64b-91b9d4f3e638 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.165220 May 10 03:20:13.586186 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 388/777] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:13 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:14.557151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:14.557764 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:14.564723 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:14.565174 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:14.565959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:14.566393 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:14.604481 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a17551be-2f6c-4b10-9623-6f18a563f63d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:14.605856 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a17551be-2f6c-4b10-9623-6f18a563f63d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:14.613799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a17551be-2f6c-4b10-9623-6f18a563f63d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:14.614500 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a17551be-2f6c-4b10-9623-6f18a563f63d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:14.615969 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a17551be-2f6c-4b10-9623-6f18a563f63d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:14.616644 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a17551be-2f6c-4b10-9623-6f18a563f63d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:14.718185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:14.730217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:14.731890 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:14.733108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b970dab7-864a-4007-b0a4-5d8367f568bc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.181264 May 10 03:20:14.733742 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 390/778] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:14 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:14.876765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a17551be-2f6c-4b10-9623-6f18a563f63d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:14.885033 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a17551be-2f6c-4b10-9623-6f18a563f63d tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.286306 May 10 03:20:14.885951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 389/779] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:14 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:15.753047 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:15.753738 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:15.760583 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:15.761058 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:15.761857 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:15.762287 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:15.896909 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:15.901991 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-96567631-df1f-4b2f-a451-e135818015dc tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:15.902601 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-96567631-df1f-4b2f-a451-e135818015dc tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:15.907446 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:15.909131 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:15.909282 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96567631-df1f-4b2f-a451-e135818015dc tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:15.909672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96567631-df1f-4b2f-a451-e135818015dc tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:15.910434 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96567631-df1f-4b2f-a451-e135818015dc tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:15.910868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-96567631-df1f-4b2f-a451-e135818015dc tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:15.911353 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e4bf7e4a-d468-48fb-8790-a8a5bffa417f tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.162030 May 10 03:20:15.912034 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 391/780] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:15 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:16.054553 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-96567631-df1f-4b2f-a451-e135818015dc tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:16.062626 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-96567631-df1f-4b2f-a451-e135818015dc tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.164360 May 10 03:20:16.063901 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 390/781] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:15 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:16.930111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:16.930726 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:16.937307 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:16.937758 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:16.938558 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:16.938995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:17.070081 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:17.077907 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:17.079404 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:17.080561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d984ebb9-34a0-471f-af4d-585b14e6d497 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.154867 May 10 03:20:17.081153 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 392/782] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:16 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:20:17.081366 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5bf0a1f6-6ca3-4e55-9858-1ad3a67364a4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:17.081980 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5bf0a1f6-6ca3-4e55-9858-1ad3a67364a4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:17.088548 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5bf0a1f6-6ca3-4e55-9858-1ad3a67364a4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:17.089060 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5bf0a1f6-6ca3-4e55-9858-1ad3a67364a4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:17.089826 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5bf0a1f6-6ca3-4e55-9858-1ad3a67364a4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:17.090255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5bf0a1f6-6ca3-4e55-9858-1ad3a67364a4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:17.227762 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5bf0a1f6-6ca3-4e55-9858-1ad3a67364a4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:17.235873 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5bf0a1f6-6ca3-4e55-9858-1ad3a67364a4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.158417 May 10 03:20:17.236433 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 391/783] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:17 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:18.098564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:18.099172 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:18.106579 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:18.107032 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:18.107799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:18.108237 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:18.239519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:18.247988 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:18.249672 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:18.250836 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9fe2764c-0615-4366-863e-f1a8b7fc7a44 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.156290 May 10 03:20:18.251568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 393/784] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:18 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:18.252706 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c5f4b1ee-9d27-468b-a40b-9852f30972d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:18.253411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c5f4b1ee-9d27-468b-a40b-9852f30972d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:18.259680 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c5f4b1ee-9d27-468b-a40b-9852f30972d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:18.260134 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c5f4b1ee-9d27-468b-a40b-9852f30972d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:18.261178 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c5f4b1ee-9d27-468b-a40b-9852f30972d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:18.261613 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c5f4b1ee-9d27-468b-a40b-9852f30972d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:18.326225 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-50ae7e02-af76-4184-9440-f3a34e5dacdf req-e71971b6-e095-4be9-a4e1-d5d81cded8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab", "name": "network-vif-plugged", "status": "completed", "tag": "8849e2ad-b7bd-40d0-aba9-d512831c8b63"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:18.335437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-50ae7e02-af76-4184-9440-f3a34e5dacdf req-e71971b6-e095-4be9-a4e1-d5d81cded8b9 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:18.335877 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-50ae7e02-af76-4184-9440-f3a34e5dacdf req-e71971b6-e095-4be9-a4e1-d5d81cded8b9 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:18.348884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-50ae7e02-af76-4184-9440-f3a34e5dacdf req-e71971b6-e095-4be9-a4e1-d5d81cded8b9 service nova] Creating event network-vif-plugged:8849e2ad-b7bd-40d0-aba9-d512831c8b63 for instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab on hv-cinder-83009 May 10 03:20:18.355102 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-50ae7e02-af76-4184-9440-f3a34e5dacdf req-e71971b6-e095-4be9-a4e1-d5d81cded8b9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 May 10 03:20:18.355769 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 394/785] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:18.414476 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c5f4b1ee-9d27-468b-a40b-9852f30972d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:18.422297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c5f4b1ee-9d27-468b-a40b-9852f30972d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.173704 May 10 03:20:18.422871 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 392/786] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:18 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:19.269481 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:19.270116 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:19.276711 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:19.277167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:19.277940 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:19.278378 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:19.407657 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:19.415926 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:19.417446 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:19.418586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-92cec42a-d9aa-4c00-933c-1e1fe908a925 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.153818 May 10 03:20:19.419151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 395/787] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:19 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:19.439892 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ef11899e-a611-4180-8dbc-a349df11ef61 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:19.440489 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ef11899e-a611-4180-8dbc-a349df11ef61 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:19.449679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef11899e-a611-4180-8dbc-a349df11ef61 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:19.450125 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef11899e-a611-4180-8dbc-a349df11ef61 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:19.450888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef11899e-a611-4180-8dbc-a349df11ef61 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:19.451319 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef11899e-a611-4180-8dbc-a349df11ef61 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:19.596415 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ef11899e-a611-4180-8dbc-a349df11ef61 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:19.604835 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ef11899e-a611-4180-8dbc-a349df11ef61 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.168971 May 10 03:20:19.605411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 393/788] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:19 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:20.360468 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2fec771b-1707-4339-a64a-d72c328dce6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:20.361111 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2fec771b-1707-4339-a64a-d72c328dce6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:20.369402 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fec771b-1707-4339-a64a-d72c328dce6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:20.369993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fec771b-1707-4339-a64a-d72c328dce6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:20.370896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fec771b-1707-4339-a64a-d72c328dce6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:20.371554 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fec771b-1707-4339-a64a-d72c328dce6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:20.397460 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2fec771b-1707-4339-a64a-d72c328dce6d tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/ips" status: 200 len: 145 microversion: 2.1 time: 0.041879 May 10 03:20:20.398789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 396/789] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:20:20 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:20.441617 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:20.444481 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:20.451777 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:20.452237 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:20.453125 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:20.453608 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:20.622133 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7027d8d7-b517-463c-9850-5565efc81fba tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:20.622992 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-7027d8d7-b517-463c-9850-5565efc81fba tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:20.629594 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7027d8d7-b517-463c-9850-5565efc81fba tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:20.630232 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7027d8d7-b517-463c-9850-5565efc81fba tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:20.631589 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7027d8d7-b517-463c-9850-5565efc81fba tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:20.632489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-7027d8d7-b517-463c-9850-5565efc81fba tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:20.640769 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:20.676173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:20.678096 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:20.679853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-528c9f12-2edc-4494-9dd0-6218fdfe1ea2 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1729 microversion: 2.20 time: 0.246348 May 10 03:20:20.680925 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 394/790] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:20 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:20.823141 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-7027d8d7-b517-463c-9850-5565efc81fba tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:20.835012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7027d8d7-b517-463c-9850-5565efc81fba tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.215247 May 10 03:20:20.835682 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 397/791] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:20 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:21.700351 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:21.701051 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:21.707005 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:21.707463 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:21.708245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:21.709306 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:21.811058 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3db022bd-f5d5-4c09-bde6-45ecfca97d15 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "177e4340-7833-4435-af2c-3797307ad4b4"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:21.812979 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3db022bd-f5d5-4c09-bde6-45ecfca97d15 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:21.820669 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3db022bd-f5d5-4c09-bde6-45ecfca97d15 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:21.821120 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3db022bd-f5d5-4c09-bde6-45ecfca97d15 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:21.821921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3db022bd-f5d5-4c09-bde6-45ecfca97d15 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:21.822355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3db022bd-f5d5-4c09-bde6-45ecfca97d15 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:21.876520 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:21.885395 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:21.886962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:21.888214 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-efdb7371-39ca-4d0a-9e0c-b52b836518e4 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1716 microversion: 2.20 time: 0.191937 May 10 03:20:21.888926 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 395/792] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:20:21 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1716 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:20:21.893571 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8167c69f-cf08-45f8-90fa-937bf4df749f tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:21.894379 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8167c69f-cf08-45f8-90fa-937bf4df749f tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:21.901083 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8167c69f-cf08-45f8-90fa-937bf4df749f tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:21.901630 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8167c69f-cf08-45f8-90fa-937bf4df749f tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:21.902606 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8167c69f-cf08-45f8-90fa-937bf4df749f tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:21.903049 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8167c69f-cf08-45f8-90fa-937bf4df749f tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:22.061732 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8167c69f-cf08-45f8-90fa-937bf4df749f tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:22.072679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8167c69f-cf08-45f8-90fa-937bf4df749f tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.182281 May 10 03:20:22.075337 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 396/793] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:21 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:22.091776 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3db022bd-f5d5-4c09-bde6-45ecfca97d15 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287086 May 10 03:20:22.092979 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 398/794] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:20:21 2022] POST /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:23.091022 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b1d68388-6b37-482b-a53d-6ea55e96d937 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:23.091642 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b1d68388-6b37-482b-a53d-6ea55e96d937 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:23.097928 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b1d68388-6b37-482b-a53d-6ea55e96d937 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:23.098382 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b1d68388-6b37-482b-a53d-6ea55e96d937 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:23.099668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b1d68388-6b37-482b-a53d-6ea55e96d937 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:23.100600 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b1d68388-6b37-482b-a53d-6ea55e96d937 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:23.251799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b1d68388-6b37-482b-a53d-6ea55e96d937 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:23.260118 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b1d68388-6b37-482b-a53d-6ea55e96d937 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1758 microversion: 2.1 time: 0.172817 May 10 03:20:23.260633 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 397/795] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:23 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:24.277736 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ab5abca2-072d-4a81-9426-347aa08c1c34 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:24.278519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ab5abca2-072d-4a81-9426-347aa08c1c34 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:24.285326 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ab5abca2-072d-4a81-9426-347aa08c1c34 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:24.285920 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ab5abca2-072d-4a81-9426-347aa08c1c34 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:24.286807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ab5abca2-072d-4a81-9426-347aa08c1c34 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:24.287349 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ab5abca2-072d-4a81-9426-347aa08c1c34 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:24.449016 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ab5abca2-072d-4a81-9426-347aa08c1c34 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:24.456804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ab5abca2-072d-4a81-9426-347aa08c1c34 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1761 microversion: 2.1 time: 0.183233 May 10 03:20:24.457369 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 399/796] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:24 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1761 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:29.600908 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e6facc09-820c-4b76-8a83-4b553441a1a2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:29.601908 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e6facc09-820c-4b76-8a83-4b553441a1a2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:29.608261 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e6facc09-820c-4b76-8a83-4b553441a1a2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:29.608749 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e6facc09-820c-4b76-8a83-4b553441a1a2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:29.609514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e6facc09-820c-4b76-8a83-4b553441a1a2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:29.609950 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e6facc09-820c-4b76-8a83-4b553441a1a2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:29.639114 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e6facc09-820c-4b76-8a83-4b553441a1a2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042625 May 10 03:20:29.639664 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 398/797] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:20:29 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:29.649426 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c8276356-c310-45a3-8f13-fa0dd3ac1278 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:29.649936 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-c8276356-c310-45a3-8f13-fa0dd3ac1278 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:29.656436 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c8276356-c310-45a3-8f13-fa0dd3ac1278 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:29.656926 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c8276356-c310-45a3-8f13-fa0dd3ac1278 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:29.657686 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c8276356-c310-45a3-8f13-fa0dd3ac1278 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:29.658116 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c8276356-c310-45a3-8f13-fa0dd3ac1278 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:29.687720 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c8276356-c310-45a3-8f13-fa0dd3ac1278 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/177e4340-7833-4435-af2c-3797307ad4b4" status: 200 len: 194 microversion: 2.1 time: 0.042238 May 10 03:20:29.688294 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 400/798] 10.222.0.55 () {58 vars in 1412 bytes} [Tue May 10 03:20:29 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/177e4340-7833-4435-af2c-3797307ad4b4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:30.990108 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f8222233-e1f1-4315-b600-43a9fbafeadb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f2d483e-4369-48d0-94ac-d0a155391903"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:30.991835 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f8222233-e1f1-4315-b600-43a9fbafeadb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:30.998516 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f8222233-e1f1-4315-b600-43a9fbafeadb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:30.999001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f8222233-e1f1-4315-b600-43a9fbafeadb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:30.999761 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f8222233-e1f1-4315-b600-43a9fbafeadb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:31.000221 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f8222233-e1f1-4315-b600-43a9fbafeadb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:31.242906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f8222233-e1f1-4315-b600-43a9fbafeadb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "POST /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256522 May 10 03:20:31.243538 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 399/799] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:20:30 2022] POST /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:35.844469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2026880507", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:35.895480 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] validate_networks() for None {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:20:36.157328 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:20:36.157743 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:20:36.158239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:20:36.158639 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:20:36.159040 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:20:36.168319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:36.168801 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:36.169600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:36.170027 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:36.185931 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Getting quotas for project 21a8caef9eca4a1c9dfcd4a5d7195443. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:20:36.189723 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Getting quotas for user d5a7722f88474e4c854863205daba9a7 and project 21a8caef9eca4a1c9dfcd4a5d7195443. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:20:36.200180 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:20:36.202480 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:20:36.245836 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-21845721-a545-4c38-b64b-664c88508f14 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.405184 May 10 03:20:36.246474 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 401/800] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:20:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:20:36.257339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b4abf718-d555-481d-b600-279f80a46672 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:36.258036 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b4abf718-d555-481d-b600-279f80a46672 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:36.311314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b4abf718-d555-481d-b600-279f80a46672 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:36.318024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b4abf718-d555-481d-b600-279f80a46672 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1215 microversion: 2.1 time: 0.065284 May 10 03:20:36.318658 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 400/801] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:36 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:37.335309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2abb45d7-5bd1-49f4-9d7f-b232bf49f84e tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:37.335885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2abb45d7-5bd1-49f4-9d7f-b232bf49f84e tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:37.341922 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2abb45d7-5bd1-49f4-9d7f-b232bf49f84e tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:37.342376 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2abb45d7-5bd1-49f4-9d7f-b232bf49f84e tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:37.343139 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2abb45d7-5bd1-49f4-9d7f-b232bf49f84e tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:37.343578 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2abb45d7-5bd1-49f4-9d7f-b232bf49f84e tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:37.407930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2abb45d7-5bd1-49f4-9d7f-b232bf49f84e tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:37.415311 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2abb45d7-5bd1-49f4-9d7f-b232bf49f84e tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1267 microversion: 2.1 time: 0.085142 May 10 03:20:37.415878 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 402/802] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:37 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:38.433427 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9b8cfc1b-cd29-472c-864d-5ef4056591f6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:38.434153 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9b8cfc1b-cd29-472c-864d-5ef4056591f6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:38.441566 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9b8cfc1b-cd29-472c-864d-5ef4056591f6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.442016 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9b8cfc1b-cd29-472c-864d-5ef4056591f6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.442795 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9b8cfc1b-cd29-472c-864d-5ef4056591f6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.443224 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9b8cfc1b-cd29-472c-864d-5ef4056591f6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.627211 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9b8cfc1b-cd29-472c-864d-5ef4056591f6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:38.635596 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9b8cfc1b-cd29-472c-864d-5ef4056591f6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1273 microversion: 2.1 time: 0.206143 May 10 03:20:38.636196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 401/803] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:38 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:38.734396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-071ce348-5bfa-4da0-bcbb-7c6046808897 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:38.735378 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-071ce348-5bfa-4da0-bcbb-7c6046808897 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:38.742458 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-071ce348-5bfa-4da0-bcbb-7c6046808897 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.742946 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-071ce348-5bfa-4da0-bcbb-7c6046808897 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.743729 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-071ce348-5bfa-4da0-bcbb-7c6046808897 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.744169 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-071ce348-5bfa-4da0-bcbb-7c6046808897 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.773420 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-071ce348-5bfa-4da0-bcbb-7c6046808897 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042862 May 10 03:20:38.773997 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 403/804] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:20:38 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:38.887033 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-eaac0c42-1c3f-43be-8e69-137d4b46283e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:38.887443 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-eaac0c42-1c3f-43be-8e69-137d4b46283e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:38.893825 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eaac0c42-1c3f-43be-8e69-137d4b46283e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.894273 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eaac0c42-1c3f-43be-8e69-137d4b46283e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.895038 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eaac0c42-1c3f-43be-8e69-137d4b46283e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.895518 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eaac0c42-1c3f-43be-8e69-137d4b46283e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.925105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-eaac0c42-1c3f-43be-8e69-137d4b46283e tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/177e4340-7833-4435-af2c-3797307ad4b4" status: 200 len: 194 microversion: 2.1 time: 0.041995 May 10 03:20:38.926011 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 402/805] 10.222.0.55 () {58 vars in 1412 bytes} [Tue May 10 03:20:38 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/177e4340-7833-4435-af2c-3797307ad4b4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:38.936659 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ddd14749-471d-4ff3-8160-773f4ed45a7c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:38.937238 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ddd14749-471d-4ff3-8160-773f4ed45a7c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:38.943315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ddd14749-471d-4ff3-8160-773f4ed45a7c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.943775 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ddd14749-471d-4ff3-8160-773f4ed45a7c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.944550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ddd14749-471d-4ff3-8160-773f4ed45a7c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.945025 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ddd14749-471d-4ff3-8160-773f4ed45a7c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:39.027176 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-ddd14749-471d-4ff3-8160-773f4ed45a7c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lazy-loading 'services' on Instance uuid 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:20:39.101046 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ddd14749-471d-4ff3-8160-773f4ed45a7c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/177e4340-7833-4435-af2c-3797307ad4b4" status: 202 len: 0 microversion: 2.1 time: 0.167279 May 10 03:20:39.101641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 404/806] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:20:38 2022] DELETE /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/177e4340-7833-4435-af2c-3797307ad4b4 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:20:39.653189 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f39ba314-5ac7-4090-868b-cf45887e4f11 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:39.654594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f39ba314-5ac7-4090-868b-cf45887e4f11 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:39.661490 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f39ba314-5ac7-4090-868b-cf45887e4f11 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:39.662022 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f39ba314-5ac7-4090-868b-cf45887e4f11 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:39.662882 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f39ba314-5ac7-4090-868b-cf45887e4f11 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:39.663531 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f39ba314-5ac7-4090-868b-cf45887e4f11 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:39.866903 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f39ba314-5ac7-4090-868b-cf45887e4f11 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:39.874453 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f39ba314-5ac7-4090-868b-cf45887e4f11 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1315 microversion: 2.1 time: 0.225157 May 10 03:20:39.875024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 403/807] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:39 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:40.210059 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-dd22ee41-8d23-4222-856c-b819c092daa3 req-0945ce9b-db6b-4605-8583-b4127874ad22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af544ec7-1727-4677-b1cd-daf17ebe614b", "tag": "4723b0a4-e221-461e-a5f0-371a71a76d61"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:40.233386 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-dd22ee41-8d23-4222-856c-b819c092daa3 req-0945ce9b-db6b-4605-8583-b4127874ad22 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:40.233842 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-dd22ee41-8d23-4222-856c-b819c092daa3 req-0945ce9b-db6b-4605-8583-b4127874ad22 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:40.249092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-df8b6411-8950-43d1-81eb-80d414893feb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:40.250495 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-df8b6411-8950-43d1-81eb-80d414893feb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:40.252456 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-dd22ee41-8d23-4222-856c-b819c092daa3 req-0945ce9b-db6b-4605-8583-b4127874ad22 service nova] Creating event network-changed:4723b0a4-e221-461e-a5f0-371a71a76d61 for instance af544ec7-1727-4677-b1cd-daf17ebe614b on hv-cinder-83009 May 10 03:20:40.258188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-dd22ee41-8d23-4222-856c-b819c092daa3 req-0945ce9b-db6b-4605-8583-b4127874ad22 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052925 May 10 03:20:40.259593 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-df8b6411-8950-43d1-81eb-80d414893feb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:40.260112 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-df8b6411-8950-43d1-81eb-80d414893feb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:40.261724 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-df8b6411-8950-43d1-81eb-80d414893feb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:40.262718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-df8b6411-8950-43d1-81eb-80d414893feb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:40.263539 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 405/808] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:40.296480 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-df8b6411-8950-43d1-81eb-80d414893feb tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/7f2d483e-4369-48d0-94ac-d0a155391903" status: 200 len: 194 microversion: 2.1 time: 0.054479 May 10 03:20:40.297193 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 404/809] 10.222.0.55 () {58 vars in 1412 bytes} [Tue May 10 03:20:40 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/7f2d483e-4369-48d0-94ac-d0a155391903 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:40.307942 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e25a7b52-0b16-4c76-b409-a9f7ed5763da tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:40.308625 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e25a7b52-0b16-4c76-b409-a9f7ed5763da tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:40.315186 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e25a7b52-0b16-4c76-b409-a9f7ed5763da tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:40.315714 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e25a7b52-0b16-4c76-b409-a9f7ed5763da tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:40.316549 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e25a7b52-0b16-4c76-b409-a9f7ed5763da tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:40.317227 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e25a7b52-0b16-4c76-b409-a9f7ed5763da tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:40.409526 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-e25a7b52-0b16-4c76-b409-a9f7ed5763da tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lazy-loading 'services' on Instance uuid 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:20:40.484475 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e25a7b52-0b16-4c76-b409-a9f7ed5763da tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/7f2d483e-4369-48d0-94ac-d0a155391903" status: 202 len: 0 microversion: 2.1 time: 0.181319 May 10 03:20:40.485470 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 406/810] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:20:40 2022] DELETE /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments/7f2d483e-4369-48d0-94ac-d0a155391903 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:20:40.891478 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-89b16cb6-7a06-4164-9007-08ddb4421747 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:40.892157 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-89b16cb6-7a06-4164-9007-08ddb4421747 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:40.900168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-89b16cb6-7a06-4164-9007-08ddb4421747 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:40.900168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-89b16cb6-7a06-4164-9007-08ddb4421747 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:40.900970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-89b16cb6-7a06-4164-9007-08ddb4421747 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:40.901448 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-89b16cb6-7a06-4164-9007-08ddb4421747 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:41.030384 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-89b16cb6-7a06-4164-9007-08ddb4421747 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:41.038338 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-89b16cb6-7a06-4164-9007-08ddb4421747 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1315 microversion: 2.1 time: 0.150211 May 10 03:20:41.038915 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 405/811] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:40 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:41.550437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8721ed4e-1558-4335-8221-01e9943d201c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:41.550864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8721ed4e-1558-4335-8221-01e9943d201c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:41.557076 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8721ed4e-1558-4335-8221-01e9943d201c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:41.557521 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8721ed4e-1558-4335-8221-01e9943d201c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:41.558295 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8721ed4e-1558-4335-8221-01e9943d201c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:41.558727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8721ed4e-1558-4335-8221-01e9943d201c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:41.581382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8721ed4e-1558-4335-8221-01e9943d201c tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/ips" status: 200 len: 148 microversion: 2.1 time: 0.036007 May 10 03:20:41.581963 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 407/812] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:20:41 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:42.055066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8be23309-7445-4552-80c3-f53509a18d80 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:42.055634 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-8be23309-7445-4552-80c3-f53509a18d80 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:42.062112 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8be23309-7445-4552-80c3-f53509a18d80 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.062567 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8be23309-7445-4552-80c3-f53509a18d80 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.063358 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8be23309-7445-4552-80c3-f53509a18d80 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.064047 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-8be23309-7445-4552-80c3-f53509a18d80 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.279153 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-8be23309-7445-4552-80c3-f53509a18d80 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:42.288804 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8be23309-7445-4552-80c3-f53509a18d80 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1315 microversion: 2.1 time: 0.237578 May 10 03:20:42.289531 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 406/813] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:42 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:42.695870 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-988c93b0-4ade-4f38-ab42-3af380f042e2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:42.696871 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-988c93b0-4ade-4f38-ab42-3af380f042e2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:42.703309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-988c93b0-4ade-4f38-ab42-3af380f042e2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.703764 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-988c93b0-4ade-4f38-ab42-3af380f042e2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.704533 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-988c93b0-4ade-4f38-ab42-3af380f042e2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.704998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-988c93b0-4ade-4f38-ab42-3af380f042e2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.734358 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-988c93b0-4ade-4f38-ab42-3af380f042e2 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042771 May 10 03:20:42.734904 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 408/814] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:20:42 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:20:42.836998 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e4ef9fec-fa2c-43d8-9096-e06439e9a638 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:42.837912 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e4ef9fec-fa2c-43d8-9096-e06439e9a638 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:42.843685 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4ef9fec-fa2c-43d8-9096-e06439e9a638 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.844134 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4ef9fec-fa2c-43d8-9096-e06439e9a638 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.844910 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4ef9fec-fa2c-43d8-9096-e06439e9a638 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.845342 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e4ef9fec-fa2c-43d8-9096-e06439e9a638 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.873876 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e4ef9fec-fa2c-43d8-9096-e06439e9a638 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041446 May 10 03:20:42.874448 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 407/815] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:20:42 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:20:42.905744 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-713a515b-79a2-4bae-bf21-4ed898a3d122 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e588bc07-9219-4684-8f44-d2d810514bea"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:42.906811 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-713a515b-79a2-4bae-bf21-4ed898a3d122 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:42.913449 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-713a515b-79a2-4bae-bf21-4ed898a3d122 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.913817 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-713a515b-79a2-4bae-bf21-4ed898a3d122 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.914586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-713a515b-79a2-4bae-bf21-4ed898a3d122 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.915021 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-713a515b-79a2-4bae-bf21-4ed898a3d122 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.931484 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3341ff77-9dd5-437d-95a2-d4afe56a47ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:42.931980 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3341ff77-9dd5-437d-95a2-d4afe56a47ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:42.937942 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3341ff77-9dd5-437d-95a2-d4afe56a47ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.938392 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3341ff77-9dd5-437d-95a2-d4afe56a47ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.939154 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3341ff77-9dd5-437d-95a2-d4afe56a47ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.939592 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3341ff77-9dd5-437d-95a2-d4afe56a47ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.964327 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3341ff77-9dd5-437d-95a2-d4afe56a47ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:20:43.040616 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3341ff77-9dd5-437d-95a2-d4afe56a47ca tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 204 len: 0 microversion: 2.1 time: 0.112682 May 10 03:20:43.044378 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 408/816] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:20:42 2022] DELETE /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:20:43.050285 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d12bfc97-40b1-4b76-ba6d-f09c60f5db52 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:43.050987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d12bfc97-40b1-4b76-ba6d-f09c60f5db52 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:43.057150 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d12bfc97-40b1-4b76-ba6d-f09c60f5db52 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:43.057767 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d12bfc97-40b1-4b76-ba6d-f09c60f5db52 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:43.058361 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d12bfc97-40b1-4b76-ba6d-f09c60f5db52 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:43.058791 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d12bfc97-40b1-4b76-ba6d-f09c60f5db52 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:43.173467 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-713a515b-79a2-4bae-bf21-4ed898a3d122 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "POST /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271569 May 10 03:20:43.174024 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 409/817] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 10 03:20:42 2022] POST /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:43.203066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d12bfc97-40b1-4b76-ba6d-f09c60f5db52 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:43.211541 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d12bfc97-40b1-4b76-ba6d-f09c60f5db52 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1671 microversion: 2.1 time: 0.165771 May 10 03:20:43.212191 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 409/818] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:43 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:43.306299 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-11c220eb-d25f-4746-bb75-57548348eec8 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:43.306983 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-11c220eb-d25f-4746-bb75-57548348eec8 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:43.313457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-11c220eb-d25f-4746-bb75-57548348eec8 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:43.313899 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-11c220eb-d25f-4746-bb75-57548348eec8 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:43.314654 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-11c220eb-d25f-4746-bb75-57548348eec8 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:43.315080 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-11c220eb-d25f-4746-bb75-57548348eec8 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:43.649450 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-11c220eb-d25f-4746-bb75-57548348eec8 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:43.657077 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-11c220eb-d25f-4746-bb75-57548348eec8 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1315 microversion: 2.1 time: 0.355071 May 10 03:20:43.657649 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 410/819] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:43 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:44.228557 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5c0bf5ef-0df9-4d80-890a-6e2a120cecf0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:44.229218 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5c0bf5ef-0df9-4d80-890a-6e2a120cecf0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:44.235918 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5c0bf5ef-0df9-4d80-890a-6e2a120cecf0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:44.236366 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5c0bf5ef-0df9-4d80-890a-6e2a120cecf0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:44.237168 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5c0bf5ef-0df9-4d80-890a-6e2a120cecf0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:44.237604 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5c0bf5ef-0df9-4d80-890a-6e2a120cecf0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:44.367030 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5c0bf5ef-0df9-4d80-890a-6e2a120cecf0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:44.374585 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5c0bf5ef-0df9-4d80-890a-6e2a120cecf0 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1671 microversion: 2.1 time: 0.149873 May 10 03:20:44.375296 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 410/820] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:44 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:44.674154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0e585273-6826-42cf-83c5-fa625a6aef5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:44.674702 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0e585273-6826-42cf-83c5-fa625a6aef5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:44.681455 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e585273-6826-42cf-83c5-fa625a6aef5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:44.681901 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e585273-6826-42cf-83c5-fa625a6aef5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:44.682683 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e585273-6826-42cf-83c5-fa625a6aef5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:44.683120 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0e585273-6826-42cf-83c5-fa625a6aef5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:44.820112 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-0e585273-6826-42cf-83c5-fa625a6aef5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:44.829949 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0e585273-6826-42cf-83c5-fa625a6aef5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1315 microversion: 2.1 time: 0.159670 May 10 03:20:44.831040 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 411/821] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:44 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:45.391718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-458c092d-b865-4051-9b2c-586d57f6d28c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:45.392331 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-458c092d-b865-4051-9b2c-586d57f6d28c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:45.398914 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-458c092d-b865-4051-9b2c-586d57f6d28c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:45.399360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-458c092d-b865-4051-9b2c-586d57f6d28c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:45.400121 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-458c092d-b865-4051-9b2c-586d57f6d28c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:45.400552 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-458c092d-b865-4051-9b2c-586d57f6d28c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:45.616773 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-458c092d-b865-4051-9b2c-586d57f6d28c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a5e1a357c4a73a33391b6f25a44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d958793e0ab4e6f8d2f296dcf6186f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:45.624066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-458c092d-b865-4051-9b2c-586d57f6d28c tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 200 len: 1671 microversion: 2.1 time: 0.236176 May 10 03:20:45.624635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 411/822] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:45 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 1671 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:45.847318 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c26d1d1c-1a34-4b43-b1aa-162c1471b5c6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:45.847951 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-c26d1d1c-1a34-4b43-b1aa-162c1471b5c6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:45.854337 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c26d1d1c-1a34-4b43-b1aa-162c1471b5c6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:45.854777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c26d1d1c-1a34-4b43-b1aa-162c1471b5c6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:45.855881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c26d1d1c-1a34-4b43-b1aa-162c1471b5c6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:45.856414 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c26d1d1c-1a34-4b43-b1aa-162c1471b5c6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:45.986478 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-c26d1d1c-1a34-4b43-b1aa-162c1471b5c6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:45.994993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c26d1d1c-1a34-4b43-b1aa-162c1471b5c6 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1315 microversion: 2.1 time: 0.151489 May 10 03:20:45.995837 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 412/823] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:45 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:46.047490 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-3121317b-7ccd-4b50-9d67-884911d32ff6 req-1b23d4f6-3362-4d38-8471-f9ebcf0005e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3477a576-5f17-49ed-9b21-6fb4c6c52dd7", "name": "network-vif-deleted", "tag": "fb909d63-5bc0-4574-995b-4f7117c39bab"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:46.054932 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-3121317b-7ccd-4b50-9d67-884911d32ff6 req-1b23d4f6-3362-4d38-8471-f9ebcf0005e5 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.055372 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-3121317b-7ccd-4b50-9d67-884911d32ff6 req-1b23d4f6-3362-4d38-8471-f9ebcf0005e5 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.067012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-3121317b-7ccd-4b50-9d67-884911d32ff6 req-1b23d4f6-3362-4d38-8471-f9ebcf0005e5 service nova] Creating event network-vif-deleted:fb909d63-5bc0-4574-995b-4f7117c39bab for instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 on hv-cinder-83009 May 10 03:20:46.072315 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-3121317b-7ccd-4b50-9d67-884911d32ff6 req-1b23d4f6-3362-4d38-8471-f9ebcf0005e5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029195 May 10 03:20:46.072939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 412/824] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:46.472540 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-feb276c0-3e7a-4042-80e8-9bf9766592d2 req-31fe4891-9801-4080-a9e7-f8e2ae352db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af544ec7-1727-4677-b1cd-daf17ebe614b", "name": "network-vif-plugged", "status": "completed", "tag": "4723b0a4-e221-461e-a5f0-371a71a76d61"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:46.481727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-feb276c0-3e7a-4042-80e8-9bf9766592d2 req-31fe4891-9801-4080-a9e7-f8e2ae352db3 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.482157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-feb276c0-3e7a-4042-80e8-9bf9766592d2 req-31fe4891-9801-4080-a9e7-f8e2ae352db3 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.495941 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-feb276c0-3e7a-4042-80e8-9bf9766592d2 req-31fe4891-9801-4080-a9e7-f8e2ae352db3 service nova] Creating event network-vif-plugged:4723b0a4-e221-461e-a5f0-371a71a76d61 for instance af544ec7-1727-4677-b1cd-daf17ebe614b on hv-cinder-83009 May 10 03:20:46.501059 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-feb276c0-3e7a-4042-80e8-9bf9766592d2 req-31fe4891-9801-4080-a9e7-f8e2ae352db3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032129 May 10 03:20:46.502282 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 413/825] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:46.642809 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:46.643453 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:46.651285 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.651870 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.652748 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.653252 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.667888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] HTTP exception thrown: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Request method failure captured: May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 HTTP/1.1 May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediTmkCRnC69AbCi4PiV4MwjGxfibgQlE-O7YVwyVd_MGAOic3dGXpsfPi5uIuctVWHuHYSiwwlwC66oOoly_mKq-KX143fMrlmkYTJs6nmvjNlthjqinBHP3Sufn8ditrsIQdSzm9HBNr4QBrsWF3Xz57LGyWsb9AKRUt95wS9W0OQ May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:20:46.669702 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5d958793e0ab4e6f8d2f296dcf6186f5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5d958793e0ab4e6f8d2f296dcf6186f5"}]}] May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 314a5e1a357c4a73a33391b6f25a44c6 May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:46.671328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '3477a576-5f17-49ed-9b21-6fb4c6c52dd7'} May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:46.672160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:46.673542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:46.674686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Returning 404 to user: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:46.674686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-62ab36d2-280a-4381-a251-74a5e38b0d95 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 404 len: 111 microversion: 2.1 time: 0.033405 May 10 03:20:46.674686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 413/826] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:46 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:20:46.681696 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-da42aa9f-70bb-464e-8db9-85056d03c999 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '.version_select at 0x7f14a44f5af0>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:46.701333 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-da42aa9f-70bb-464e-8db9-85056d03c999 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-58635976" status: 202 len: 0 microversion: 2.1 time: 0.024333 May 10 03:20:46.702313 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 414/827] 10.222.0.55 () {58 vars in 1214 bytes} [Tue May 10 03:20:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-58635976 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:20:47.011284 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ff34ac8e-e818-4e47-9eb0-2a2a48376c69 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:47.011902 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ff34ac8e-e818-4e47-9eb0-2a2a48376c69 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:47.019325 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ff34ac8e-e818-4e47-9eb0-2a2a48376c69 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:47.019776 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ff34ac8e-e818-4e47-9eb0-2a2a48376c69 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:47.020580 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ff34ac8e-e818-4e47-9eb0-2a2a48376c69 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:47.021042 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ff34ac8e-e818-4e47-9eb0-2a2a48376c69 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:47.163163 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ff34ac8e-e818-4e47-9eb0-2a2a48376c69 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:47.171177 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ff34ac8e-e818-4e47-9eb0-2a2a48376c69 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1315 microversion: 2.1 time: 0.163685 May 10 03:20:47.171779 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 414/828] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:47 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:48.189275 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-496b0dfa-97aa-44ef-8b64-97bc4413ac49 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:48.190009 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-496b0dfa-97aa-44ef-8b64-97bc4413ac49 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:48.196948 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-496b0dfa-97aa-44ef-8b64-97bc4413ac49 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:48.197399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-496b0dfa-97aa-44ef-8b64-97bc4413ac49 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:48.198171 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-496b0dfa-97aa-44ef-8b64-97bc4413ac49 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:48.198722 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-496b0dfa-97aa-44ef-8b64-97bc4413ac49 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:48.332958 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-496b0dfa-97aa-44ef-8b64-97bc4413ac49 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:48.340711 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-496b0dfa-97aa-44ef-8b64-97bc4413ac49 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1315 microversion: 2.1 time: 0.155315 May 10 03:20:48.341283 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 415/829] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:48 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:49.358209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5f14f327-1f39-444d-9a73-ea677ebac237 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:49.358728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5f14f327-1f39-444d-9a73-ea677ebac237 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:49.365679 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f14f327-1f39-444d-9a73-ea677ebac237 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.366227 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f14f327-1f39-444d-9a73-ea677ebac237 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.367001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f14f327-1f39-444d-9a73-ea677ebac237 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.367430 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f14f327-1f39-444d-9a73-ea677ebac237 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.493447 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5f14f327-1f39-444d-9a73-ea677ebac237 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:49.500622 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5f14f327-1f39-444d-9a73-ea677ebac237 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1464 microversion: 2.1 time: 0.146343 May 10 03:20:49.501206 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 415/830] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:49 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:49.539888 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-66a9a356-e7bc-43ab-b0b8-148dbe689dc9 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:49.540384 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-66a9a356-e7bc-43ab-b0b8-148dbe689dc9 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:49.546711 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-66a9a356-e7bc-43ab-b0b8-148dbe689dc9 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.547157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-66a9a356-e7bc-43ab-b0b8-148dbe689dc9 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.547919 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-66a9a356-e7bc-43ab-b0b8-148dbe689dc9 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.548344 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-66a9a356-e7bc-43ab-b0b8-148dbe689dc9 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.574082 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-66a9a356-e7bc-43ab-b0b8-148dbe689dc9 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:20:49.613542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:49.614113 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:49.620440 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.620933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.621700 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.622139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.635573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] HTTP exception thrown: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Request method failure captured: May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: DELETE /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 HTTP/1.1 May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediTmkCRnC69AbCi4PiV4MwjGxfibgQlE-O7YVwyVd_MGAOic3dGXpsfPi5uIuctVWHuHYSiwwlwC66oOoly_mKq-KX143fMrlmkYTJs6nmvjNlthjqinBHP3Sufn8ditrsIQdSzm9HBNr4QBrsWF3Xz57LGyWsb9AKRUt95wS9W0OQ May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:20:49.637135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5d958793e0ab4e6f8d2f296dcf6186f5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5d958793e0ab4e6f8d2f296dcf6186f5"}]}] May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 314a5e1a357c4a73a33391b6f25a44c6 May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.638643 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '3477a576-5f17-49ed-9b21-6fb4c6c52dd7'} May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:49.639586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.641029 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.643995 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Returning 404 to user: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:49.643995 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6f168a74-7bec-48c0-8eed-3a5bb9429720 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 404 len: 111 microversion: 2.1 time: 0.028912 May 10 03:20:49.643995 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 416/831] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:20:49 2022] DELETE /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:20:49.648182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:49.648836 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 3477a576-5f17-49ed-9b21-6fb4c6c52dd7] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:49.653057 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-66a9a356-e7bc-43ab-b0b8-148dbe689dc9 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "DELETE /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 204 len: 0 microversion: 2.1 time: 0.117473 May 10 03:20:49.654141 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 416/832] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:20:49 2022] DELETE /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:20:49.655054 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.655465 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.656245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.656697 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.666164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-15566c9c-dc46-457b-a3fe-5794c68bed47 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:49.666864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-15566c9c-dc46-457b-a3fe-5794c68bed47 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:49.671166 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] HTTP exception thrown: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Request method failure captured: May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 HTTP/1.1 May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediTmkCRnC69AbCi4PiV4MwjGxfibgQlE-O7YVwyVd_MGAOic3dGXpsfPi5uIuctVWHuHYSiwwlwC66oOoly_mKq-KX143fMrlmkYTJs6nmvjNlthjqinBHP3Sufn8ditrsIQdSzm9HBNr4QBrsWF3Xz57LGyWsb9AKRUt95wS9W0OQ May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:20:49.672718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5d958793e0ab4e6f8d2f296dcf6186f5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5d958793e0ab4e6f8d2f296dcf6186f5"}]}] May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 314a5e1a357c4a73a33391b6f25a44c6 May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.673970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '3477a576-5f17-49ed-9b21-6fb4c6c52dd7'} May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:49.674716 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. May 10 03:20:49.676594 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:49.678269 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15566c9c-dc46-457b-a3fe-5794c68bed47 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.678367 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Returning 404 to user: Instance 3477a576-5f17-49ed-9b21-6fb4c6c52dd7 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:49.678464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15566c9c-dc46-457b-a3fe-5794c68bed47 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.678464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15566c9c-dc46-457b-a3fe-5794c68bed47 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.678647 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4d973bd7-3a10-4535-b8ca-b9c3aa3f9ade tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7" status: 404 len: 111 microversion: 2.1 time: 0.030995 May 10 03:20:49.678744 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-15566c9c-dc46-457b-a3fe-5794c68bed47 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.678835 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 417/833] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:49 2022] GET /compute/v2.1/servers/3477a576-5f17-49ed-9b21-6fb4c6c52dd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:20:49.812892 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-15566c9c-dc46-457b-a3fe-5794c68bed47 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:49.820530 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-15566c9c-dc46-457b-a3fe-5794c68bed47 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1470 microversion: 2.1 time: 0.161023 May 10 03:20:49.821141 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 417/834] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:49 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:50.806101 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:50.806583 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:50.812836 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.813282 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.814040 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.814467 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.827303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] HTTP exception thrown: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Request method failure captured: May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: DELETE /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f HTTP/1.1 May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediTmkCRnC69AbCi4PiV4MwjGxfibgQlE-O7YVwyVd_MGAOic3dGXpsfPi5uIuctVWHuHYSiwwlwC66oOoly_mKq-KX143fMrlmkYTJs6nmvjNlthjqinBHP3Sufn8ditrsIQdSzm9HBNr4QBrsWF3Xz57LGyWsb9AKRUt95wS9W0OQ May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:20:50.828821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5d958793e0ab4e6f8d2f296dcf6186f5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5d958793e0ab4e6f8d2f296dcf6186f5"}]}] May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 314a5e1a357c4a73a33391b6f25a44c6 May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.830339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '03eee221-c04f-48de-b2eb-5e696a377e0f'} May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:50.831210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.832510 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.834411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Returning 404 to user: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:50.834411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-87f26516-e04d-4b09-9175-340168d3c568 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "DELETE /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 404 len: 111 microversion: 2.1 time: 0.028546 May 10 03:20:50.834411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 418/835] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:20:50 2022] DELETE /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:20:50.837941 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:50.838139 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-af17cb15-e328-470e-bd18-0898307b5d92 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:50.838625 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] [instance: 03eee221-c04f-48de-b2eb-5e696a377e0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:50.838799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-af17cb15-e328-470e-bd18-0898307b5d92 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:50.844328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.844745 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.845013 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af17cb15-e328-470e-bd18-0898307b5d92 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.845466 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af17cb15-e328-470e-bd18-0898307b5d92 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.845566 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.845914 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.846238 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af17cb15-e328-470e-bd18-0898307b5d92 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.846674 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-af17cb15-e328-470e-bd18-0898307b5d92 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.859486 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] HTTP exception thrown: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Request method failure captured: May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f HTTP/1.1 May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediTmkCRnC69AbCi4PiV4MwjGxfibgQlE-O7YVwyVd_MGAOic3dGXpsfPi5uIuctVWHuHYSiwwlwC66oOoly_mKq-KX143fMrlmkYTJs6nmvjNlthjqinBHP3Sufn8ditrsIQdSzm9HBNr4QBrsWF3Xz57LGyWsb9AKRUt95wS9W0OQ May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:20:50.861024 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d958793e0ab4e6f8d2f296dcf6186f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5d958793e0ab4e6f8d2f296dcf6186f5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5d958793e0ab4e6f8d2f296dcf6186f5"}]}] May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5d958793e0ab4e6f8d2f296dcf6186f5 May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821039241 May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 314a5e1a357c4a73a33391b6f25a44c6 May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeTestJSON-821039241-project May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.862673 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '03eee221-c04f-48de-b2eb-5e696a377e0f'} May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:50.863715 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. May 10 03:20:50.866067 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:50.868175 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] Returning 404 to user: Instance 03eee221-c04f-48de-b2eb-5e696a377e0f could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:50.868175 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d822cf13-4131-4e23-a54a-09b32ac8fa97 tempest-AttachVolumeTestJSON-821039241 tempest-AttachVolumeTestJSON-821039241-project] 10.222.0.55 "GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f" status: 404 len: 111 microversion: 2.1 time: 0.027974 May 10 03:20:50.868175 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 419/836] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:50 2022] GET /compute/v2.1/servers/03eee221-c04f-48de-b2eb-5e696a377e0f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:20:50.978535 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-af17cb15-e328-470e-bd18-0898307b5d92 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:50.985888 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-af17cb15-e328-470e-bd18-0898307b5d92 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1470 microversion: 2.1 time: 0.151479 May 10 03:20:50.986464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 418/837] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:50 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:52.003273 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b01fb2de-f2d8-4c4b-ace8-9826e302d308 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:52.004513 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b01fb2de-f2d8-4c4b-ace8-9826e302d308 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:52.010912 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b01fb2de-f2d8-4c4b-ace8-9826e302d308 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.011584 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b01fb2de-f2d8-4c4b-ace8-9826e302d308 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.012535 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b01fb2de-f2d8-4c4b-ace8-9826e302d308 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.013150 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b01fb2de-f2d8-4c4b-ace8-9826e302d308 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.267401 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-3236e458-2f7e-4e9e-97d8-2281cd2ddc58 req-66840dc4-c863-4046-9a96-13ecef3b20c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af544ec7-1727-4677-b1cd-daf17ebe614b", "name": "network-vif-deleted", "tag": "4723b0a4-e221-461e-a5f0-371a71a76d61"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:52.295472 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-3236e458-2f7e-4e9e-97d8-2281cd2ddc58 req-66840dc4-c863-4046-9a96-13ecef3b20c2 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.296411 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-3236e458-2f7e-4e9e-97d8-2281cd2ddc58 req-66840dc4-c863-4046-9a96-13ecef3b20c2 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.323491 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-3236e458-2f7e-4e9e-97d8-2281cd2ddc58 req-66840dc4-c863-4046-9a96-13ecef3b20c2 service nova] Creating event network-vif-deleted:4723b0a4-e221-461e-a5f0-371a71a76d61 for instance af544ec7-1727-4677-b1cd-daf17ebe614b on hv-cinder-83009 May 10 03:20:52.341730 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-3236e458-2f7e-4e9e-97d8-2281cd2ddc58 req-66840dc4-c863-4046-9a96-13ecef3b20c2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077851 May 10 03:20:52.353461 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 419/838] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:52.374481 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b01fb2de-f2d8-4c4b-ace8-9826e302d308 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a7722f88474e4c854863205daba9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a8caef9eca4a1c9dfcd4a5d7195443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:52.384851 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b01fb2de-f2d8-4c4b-ace8-9826e302d308 tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 200 len: 1428 microversion: 2.1 time: 0.385142 May 10 03:20:52.385583 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 420/839] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:51 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 1428 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:52.900359 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-da963ddb-04fa-4fa8-8638-662cea117f6a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:52.901081 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-da963ddb-04fa-4fa8-8638-662cea117f6a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:52.907645 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da963ddb-04fa-4fa8-8638-662cea117f6a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.908095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da963ddb-04fa-4fa8-8638-662cea117f6a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.908900 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da963ddb-04fa-4fa8-8638-662cea117f6a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.909346 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da963ddb-04fa-4fa8-8638-662cea117f6a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.991355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-da963ddb-04fa-4fa8-8638-662cea117f6a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lazy-loading 'services' on Instance uuid 81d16034-b3aa-45db-82ac-5151dfb9eed6 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:20:53.067079 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-da963ddb-04fa-4fa8-8638-662cea117f6a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-volume_attachments/e588bc07-9219-4684-8f44-d2d810514bea" status: 202 len: 0 microversion: 2.1 time: 0.171437 May 10 03:20:53.071331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 420/840] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:20:52 2022] DELETE /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-volume_attachments/e588bc07-9219-4684-8f44-d2d810514bea => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:20:53.078860 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-25edf0f1-c467-4d6c-863a-61209e86bba0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:53.079814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-25edf0f1-c467-4d6c-863a-61209e86bba0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:53.088245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-25edf0f1-c467-4d6c-863a-61209e86bba0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:53.088774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-25edf0f1-c467-4d6c-863a-61209e86bba0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:53.090033 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-25edf0f1-c467-4d6c-863a-61209e86bba0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:53.090478 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-25edf0f1-c467-4d6c-863a-61209e86bba0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:53.128075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-25edf0f1-c467-4d6c-863a-61209e86bba0 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055306 May 10 03:20:53.128749 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 421/841] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:20:53 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:53.403483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:53.404194 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] [instance: af544ec7-1727-4677-b1cd-daf17ebe614b] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:53.411088 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:53.411425 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:53.412987 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:53.413697 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:53.432514 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] HTTP exception thrown: Instance af544ec7-1727-4677-b1cd-daf17ebe614b could not be found. May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Request method failure captured: May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b HTTP/1.1 May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedoCmxLW1Oh1MErvDLssOUS594MYzV3ki27sIT1aKmBFzutg3DcY6MF5ROa3-ruqheqO3a8ycZqlrqk92RHFp9-qBYsTI2GlPACpa3ULrkzMm50WxhlQ7PZbWjRIEjO1ertgIQVYR28ysomK1FdVYilPYI7gDUqtg_XLwNuT-xF1WZ0 May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 21a8caef9eca4a1c9dfcd4a5d7195443 May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-VolumesNegativeTest-452215710 May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:20:53.434217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/21a8caef9eca4a1c9dfcd4a5d7195443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/21a8caef9eca4a1c9dfcd4a5d7195443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_21a8caef9eca4a1c9dfcd4a5d7195443", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/21a8caef9eca4a1c9dfcd4a5d7195443"}]}] May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-VolumesNegativeTest-452215710 May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 21a8caef9eca4a1c9dfcd4a5d7195443 May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-VolumesNegativeTest-452215710 May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-VolumesNegativeTest-452215710-project May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: d5a7722f88474e4c854863205daba9a7 May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-VolumesNegativeTest-452215710-project May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance af544ec7-1727-4677-b1cd-daf17ebe614b could not be found. May 10 03:20:53.435568 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': 'af544ec7-1727-4677-b1cd-daf17ebe614b'} May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af544ec7-1727-4677-b1cd-daf17ebe614b could not be found. May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:53.436345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af544ec7-1727-4677-b1cd-daf17ebe614b could not be found. May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af544ec7-1727-4677-b1cd-daf17ebe614b could not be found. May 10 03:20:53.438616 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:20:53.447709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] Returning 404 to user: Instance af544ec7-1727-4677-b1cd-daf17ebe614b could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:53.447709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-bc3bf02e-54a5-4f0d-8593-50c759855e5b tempest-VolumesNegativeTest-452215710 tempest-VolumesNegativeTest-452215710-project] 10.222.0.55 "GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b" status: 404 len: 111 microversion: 2.1 time: 0.036913 May 10 03:20:53.447709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 421/842] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:53 2022] GET /compute/v2.1/servers/af544ec7-1727-4677-b1cd-daf17ebe614b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:20:54.139629 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2eff07b2-6dfe-473f-ac92-f84ddd78f83a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:54.141288 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2eff07b2-6dfe-473f-ac92-f84ddd78f83a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:54.149445 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2eff07b2-6dfe-473f-ac92-f84ddd78f83a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.149898 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2eff07b2-6dfe-473f-ac92-f84ddd78f83a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.150861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2eff07b2-6dfe-473f-ac92-f84ddd78f83a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.151294 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2eff07b2-6dfe-473f-ac92-f84ddd78f83a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.228675 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2eff07b2-6dfe-473f-ac92-f84ddd78f83a tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092868 May 10 03:20:54.230057 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 422/843] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:20:54 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:20:54.313621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1696a3e1-bd3d-4720-a833-c8a462fc0f47 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:54.314121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1696a3e1-bd3d-4720-a833-c8a462fc0f47 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:54.320557 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1696a3e1-bd3d-4720-a833-c8a462fc0f47 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.321261 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1696a3e1-bd3d-4720-a833-c8a462fc0f47 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.322239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1696a3e1-bd3d-4720-a833-c8a462fc0f47 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.322832 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1696a3e1-bd3d-4720-a833-c8a462fc0f47 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.355902 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1696a3e1-bd3d-4720-a833-c8a462fc0f47 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:20:54.484501 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1696a3e1-bd3d-4720-a833-c8a462fc0f47 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 204 len: 0 microversion: 2.1 time: 0.174984 May 10 03:20:54.485698 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 422/844] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:20:54 2022] DELETE /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:20:54.494500 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-97d1bf57-4f68-42d2-ba2a-d8f62ae3c71e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:54.494848 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-97d1bf57-4f68-42d2-ba2a-d8f62ae3c71e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:54.504030 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-97d1bf57-4f68-42d2-ba2a-d8f62ae3c71e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.504536 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-97d1bf57-4f68-42d2-ba2a-d8f62ae3c71e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.505339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-97d1bf57-4f68-42d2-ba2a-d8f62ae3c71e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.506390 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-97d1bf57-4f68-42d2-ba2a-d8f62ae3c71e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.706870 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-97d1bf57-4f68-42d2-ba2a-d8f62ae3c71e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:54.715160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-97d1bf57-4f68-42d2-ba2a-d8f62ae3c71e tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1678 microversion: 2.1 time: 0.225180 May 10 03:20:54.717255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 423/845] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:54 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:55.734004 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3c0007bc-32d0-4a3b-a99b-ddf56e222a75 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:55.734704 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3c0007bc-32d0-4a3b-a99b-ddf56e222a75 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:55.741271 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3c0007bc-32d0-4a3b-a99b-ddf56e222a75 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:55.741995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3c0007bc-32d0-4a3b-a99b-ddf56e222a75 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:55.743107 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3c0007bc-32d0-4a3b-a99b-ddf56e222a75 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:55.744005 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3c0007bc-32d0-4a3b-a99b-ddf56e222a75 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:55.905093 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3c0007bc-32d0-4a3b-a99b-ddf56e222a75 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:55.914665 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3c0007bc-32d0-4a3b-a99b-ddf56e222a75 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1678 microversion: 2.1 time: 0.184717 May 10 03:20:55.915204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 423/846] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:55 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:56.933428 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a63e61de-3eab-4b8f-be17-eb65bfee117f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:56.934744 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a63e61de-3eab-4b8f-be17-eb65bfee117f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:56.943788 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a63e61de-3eab-4b8f-be17-eb65bfee117f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:56.944526 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a63e61de-3eab-4b8f-be17-eb65bfee117f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:56.945421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a63e61de-3eab-4b8f-be17-eb65bfee117f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:56.946075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a63e61de-3eab-4b8f-be17-eb65bfee117f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:57.320987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a63e61de-3eab-4b8f-be17-eb65bfee117f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775d3d61ab8d42c3a528028592ad71f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2376b2c653467b885e8f3deb5018e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:57.328954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a63e61de-3eab-4b8f-be17-eb65bfee117f tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 200 len: 1611 microversion: 2.1 time: 0.400398 May 10 03:20:57.339353 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 424/847] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:56 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 1611 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:57.511026 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-1af1fe81-d3ef-4f3f-8180-295574914956 req-2f82d161-b654-4340-8e4b-8a7257d8b904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d16034-b3aa-45db-82ac-5151dfb9eed6", "name": "network-vif-deleted", "tag": "0607fff6-66e9-4d7d-ac75-7c3731cd5c53"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:57.520331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-1af1fe81-d3ef-4f3f-8180-295574914956 req-2f82d161-b654-4340-8e4b-8a7257d8b904 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:57.521300 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-1af1fe81-d3ef-4f3f-8180-295574914956 req-2f82d161-b654-4340-8e4b-8a7257d8b904 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:57.533621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-1af1fe81-d3ef-4f3f-8180-295574914956 req-2f82d161-b654-4340-8e4b-8a7257d8b904 service nova] Creating event network-vif-deleted:0607fff6-66e9-4d7d-ac75-7c3731cd5c53 for instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 on hv-cinder-83009 May 10 03:20:57.539879 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-1af1fe81-d3ef-4f3f-8180-295574914956 req-2f82d161-b654-4340-8e4b-8a7257d8b904 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032119 May 10 03:20:57.540476 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 424/848] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:58.346678 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:58.347300 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:58.355681 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.356866 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.357823 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.358436 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.382156 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 HTTP/1.1 May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:20:58.384141 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:20:58.385817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '81d16034-b3aa-45db-82ac-5151dfb9eed6'} May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:58.386694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:20:58.387927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:20:58.389619 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:58.390444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-82ce019c-34bf-4a49-8cc8-38aa1be40e69 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 404 len: 111 microversion: 2.1 time: 0.047648 May 10 03:20:58.392789 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 425/849] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:20:58 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:20:58.401840 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fb55f0bc-7f74-477e-a76d-e8cc668dbfe6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '.version_select at 0x7f14a44f5af0>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:58.423118 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fb55f0bc-7f74-477e-a76d-e8cc668dbfe6 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-320499404" status: 202 len: 0 microversion: 2.1 time: 0.026874 May 10 03:20:58.423690 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 425/850] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 10 03:20:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-320499404 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:00.284759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a63f6010-f18f-49f1-93f0-338996c2e384 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:00.285789 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a63f6010-f18f-49f1-93f0-338996c2e384 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:00.292794 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a63f6010-f18f-49f1-93f0-338996c2e384 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.293245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a63f6010-f18f-49f1-93f0-338996c2e384 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.294011 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a63f6010-f18f-49f1-93f0-338996c2e384 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.294444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a63f6010-f18f-49f1-93f0-338996c2e384 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.325258 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a63f6010-f18f-49f1-93f0-338996c2e384 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044310 May 10 03:21:00.330926 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 426/851] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 10 03:21:00 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:00.354432 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:00.355051 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:00.361222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.361588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.362358 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.362924 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.376586 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: DELETE /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 HTTP/1.1 May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:00.378293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.379567 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '81d16034-b3aa-45db-82ac-5151dfb9eed6'} May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:00.380370 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.381592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.382833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:00.382833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-6d2f8c4a-a31c-4682-ae29-13e015894131 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 404 len: 111 microversion: 2.1 time: 0.029660 May 10 03:21:00.382833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 426/852] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:21:00 2022] DELETE /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:21:00.389986 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4630c9b5-5c32-4562-8284-2cf674fa6c32 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:00.390562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4630c9b5-5c32-4562-8284-2cf674fa6c32 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:00.393791 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:00.394473 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 81d16034-b3aa-45db-82ac-5151dfb9eed6] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:00.397883 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4630c9b5-5c32-4562-8284-2cf674fa6c32 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.398421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4630c9b5-5c32-4562-8284-2cf674fa6c32 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.399278 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4630c9b5-5c32-4562-8284-2cf674fa6c32 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.399785 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4630c9b5-5c32-4562-8284-2cf674fa6c32 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.401993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.402443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.403519 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.404120 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.420951 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 HTTP/1.1 May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:00.422717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.424302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '81d16034-b3aa-45db-82ac-5151dfb9eed6'} May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:00.425167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. May 10 03:21:00.426561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:00.428755 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance 81d16034-b3aa-45db-82ac-5151dfb9eed6 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:00.429989 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-475a6123-838b-4cf7-8ef9-80c8ce1d66ce tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6" status: 404 len: 111 microversion: 2.1 time: 0.040215 May 10 03:21:00.431067 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 427/853] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:21:00 2022] GET /compute/v2.1/servers/81d16034-b3aa-45db-82ac-5151dfb9eed6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:21:00.431660 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4630c9b5-5c32-4562-8284-2cf674fa6c32 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:21:00.527409 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4630c9b5-5c32-4562-8284-2cf674fa6c32 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "DELETE /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 204 len: 0 microversion: 2.20 time: 0.141241 May 10 03:21:00.527997 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 427/854] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 10 03:21:00 2022] DELETE /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 03:21:00.538787 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:00.539481 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:00.545780 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.546229 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.547003 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.547426 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.725187 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.733580 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.735224 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.737062 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-463e037d-f7c6-4a71-9c35-c7fc58186df6 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.203221 May 10 03:21:00.737903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 428/855] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:21:00 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:01.569817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.570668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.576904 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.577445 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.578292 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.578733 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.593462 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: DELETE /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c HTTP/1.1 May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:21:01.595412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.596972 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '972b595f-8244-44db-a40a-203044d9c20c'} May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:01.597897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.600360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.602098 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:01.602098 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-246a68dd-8978-4393-a9d3-522c51ae21f2 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 404 len: 111 microversion: 2.1 time: 0.031771 May 10 03:21:01.602098 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 428/856] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:21:01 2022] DELETE /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:21:01.606900 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.607719 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 972b595f-8244-44db-a40a-203044d9c20c] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.614384 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.614937 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.615772 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.616270 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.630228 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c HTTP/1.1 May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:01.631813 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.633331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '972b595f-8244-44db-a40a-203044d9c20c'} May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:01.634199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. May 10 03:21:01.635601 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.636894 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance 972b595f-8244-44db-a40a-203044d9c20c could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:01.636894 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f4ccfa75-6cef-4b96-94e9-e3879128dda4 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c" status: 404 len: 111 microversion: 2.1 time: 0.031526 May 10 03:21:01.637448 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 429/857] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:21:01 2022] GET /compute/v2.1/servers/972b595f-8244-44db-a40a-203044d9c20c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:21:01.644339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.644878 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.651513 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.651962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.655629 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.655629 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.672233 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: DELETE /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf HTTP/1.1 May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:21:01.673917 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.675556 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '5e38f9a8-3e80-482e-8726-0ce7f4da09cf'} May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:01.676455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.677907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:01.679179 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:01.679179 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-10030fc7-ee2d-481a-87a1-4e37544f8824 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 404 len: 111 microversion: 2.1 time: 0.036188 May 10 03:21:01.679179 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 429/858] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:21:01 2022] DELETE /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:21:01.685542 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.686156 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: 5e38f9a8-3e80-482e-8726-0ce7f4da09cf] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.692185 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.692688 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.693464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.693893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.707664 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf HTTP/1.1 May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:01.710170 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.711777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '5e38f9a8-3e80-482e-8726-0ce7f4da09cf'} May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:01.712778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. May 10 03:21:01.714056 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:01.715211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance 5e38f9a8-3e80-482e-8726-0ce7f4da09cf could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:01.715211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5c2359ba-e67e-4d51-8d6e-237edb9f9af1 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf" status: 404 len: 111 microversion: 2.1 time: 0.029821 May 10 03:21:01.715211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 430/859] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:21:01 2022] GET /compute/v2.1/servers/5e38f9a8-3e80-482e-8726-0ce7f4da09cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:21:01.756034 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.756504 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.763223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.763680 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.764453 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.764912 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.903635 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.912764 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.914331 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.915488 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-48c8849f-f2ad-4f74-a663-cf45833522e5 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.163830 May 10 03:21:01.916240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 430/860] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:21:01 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:02.934488 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:02.935125 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:02.941585 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.942034 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:02.942980 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.943320 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.079827 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:03.087937 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:03.089611 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:03.090901 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b4acf24b-62a6-4469-a6d9-31345254ba99 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.160398 May 10 03:21:03.091532 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 431/861] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:21:02 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:03.818722 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d421c72c-6693-442c-87b2-c37be777e4b0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1744991582"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:03.819254 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d421c72c-6693-442c-87b2-c37be777e4b0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:03.825590 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d421c72c-6693-442c-87b2-c37be777e4b0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.826036 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d421c72c-6693-442c-87b2-c37be777e4b0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.826795 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d421c72c-6693-442c-87b2-c37be777e4b0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.827224 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d421c72c-6693-442c-87b2-c37be777e4b0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.039167 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.network.security_group_api [None req-d421c72c-6693-442c-87b2-c37be777e4b0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Removing security group 2a5fe8a8-5cad-4baa-9d67-c7278c2e07fe from port f02b6a99-10e5-411e-be0e-44e837772e46 May 10 03:21:04.109340 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:04.110552 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:04.118251 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.118990 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.119964 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.120595 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.303995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:04.319569 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:04.321331 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:04.322606 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-19695117-5173-4638-9737-7d7ba18b49c1 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1722 microversion: 2.20 time: 0.217164 May 10 03:21:04.323245 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 432/862] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:21:04 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:04.710865 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d421c72c-6693-442c-87b2-c37be777e4b0 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "POST /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/action" status: 202 len: 0 microversion: 2.1 time: 0.896140 May 10 03:21:04.711757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 431/863] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:21:03 2022] POST /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/action => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:04.723886 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-18a142bf-4b4a-4d6d-9f67-1b2d1abd93ab req-35486308-9840-49d2-a13f-d39927c36b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0144796a-ba13-4fb0-b9a6-ce953cbc7b60", "tag": "f02b6a99-10e5-411e-be0e-44e837772e46"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:04.740022 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-18a142bf-4b4a-4d6d-9f67-1b2d1abd93ab req-35486308-9840-49d2-a13f-d39927c36b92 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.741443 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-18a142bf-4b4a-4d6d-9f67-1b2d1abd93ab req-35486308-9840-49d2-a13f-d39927c36b92 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.776914 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-18a142bf-4b4a-4d6d-9f67-1b2d1abd93ab req-35486308-9840-49d2-a13f-d39927c36b92 service nova] Creating event network-changed:f02b6a99-10e5-411e-be0e-44e837772e46 for instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 on hv-cinder-83009 May 10 03:21:04.789067 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-18a142bf-4b4a-4d6d-9f67-1b2d1abd93ab req-35486308-9840-49d2-a13f-d39927c36b92 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070331 May 10 03:21:04.790080 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 433/864] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:21:04.956062 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:04.956514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:04.963566 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.964023 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.964837 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.965323 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.996797 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: DELETE /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb HTTP/1.1 May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:21:04.998992 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:05.000470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': 'e867a0c9-e715-4ac3-8be5-1bb4e64f56fb'} May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:05.001491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:05.002814 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:05.004958 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:05.006551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4ae84e2e-de22-45f7-babf-3bb909556807 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 404 len: 111 microversion: 2.1 time: 0.054909 May 10 03:21:05.007263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 432/865] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:21:04 2022] DELETE /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:21:05.015794 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:05.016752 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] [instance: e867a0c9-e715-4ac3-8be5-1bb4e64f56fb] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:05.024150 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.024909 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.027662 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.028267 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.048270 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] HTTP exception thrown: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Request method failure captured: May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb HTTP/1.1 May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediRfC9Dsq3Ry10lT13si-60bXgEINbb0Sk_HYY4YohFNvaf62n4AEMK3rfW7DAXxRi53Xac0h9XG6niyFTALlbojqIzJokMc5sZAksXcZ9KX7gTAvelLLoDf6TPGVMxw-0CBuOWgfcLRBZVtd0_lJhO0nQZbgRARkiNxGA0RT411NQ May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:05.057274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5a2376b2c653467b885e8f3deb5018e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5a2376b2c653467b885e8f3deb5018e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5a2376b2c653467b885e8f3deb5018e7"}]}] May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 5a2376b2c653467b885e8f3deb5018e7 May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2114051561 May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 775d3d61ab8d42c3a528028592ad71f8 May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeNegativeTest-2114051561-project May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:05.058673 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': 'e867a0c9-e715-4ac3-8be5-1bb4e64f56fb'} May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:05.059469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. May 10 03:21:05.060864 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:05.061991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] Returning 404 to user: Instance e867a0c9-e715-4ac3-8be5-1bb4e64f56fb could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:05.061991 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0750edd2-e7f3-4b91-9ca3-584d92461fe3 tempest-AttachVolumeNegativeTest-2114051561 tempest-AttachVolumeNegativeTest-2114051561-project] 10.222.0.55 "GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb" status: 404 len: 111 microversion: 2.1 time: 0.047232 May 10 03:21:05.065964 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 434/866] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:21:05 2022] GET /compute/v2.1/servers/e867a0c9-e715-4ac3-8be5-1bb4e64f56fb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:21:05.341037 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:05.342065 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:05.349496 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.350181 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.351160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.351960 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.478161 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.494966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.497063 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.498497 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5f15702c-ec8c-4dd6-b1d1-451c892b6f82 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1654 microversion: 2.20 time: 0.161714 May 10 03:21:05.499082 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 433/867] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:21:05 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1654 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:06.519859 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:06.520597 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:06.528729 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.529294 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.530458 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.530993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.631264 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:06.640789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:06.642327 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3337faba84d0aa85df4121ffb5cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4149fee898c44c180ae1de15ac9d9da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:06.643491 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1f1a4cc5-5a40-46ea-b289-61f8adeb32fc tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 200 len: 1654 microversion: 2.20 time: 0.128026 May 10 03:21:06.644047 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 435/868] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:21:06 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 1654 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:06.810293 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-c9dc03e5-5b32-4a26-ab11-2b0b46ff45fc req-db3c8256-d4d7-4817-a76c-da0a33750640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab", "name": "network-vif-deleted", "tag": "8849e2ad-b7bd-40d0-aba9-d512831c8b63"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:06.818821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-c9dc03e5-5b32-4a26-ab11-2b0b46ff45fc req-db3c8256-d4d7-4817-a76c-da0a33750640 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.819263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-c9dc03e5-5b32-4a26-ab11-2b0b46ff45fc req-db3c8256-d4d7-4817-a76c-da0a33750640 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.830179 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-c9dc03e5-5b32-4a26-ab11-2b0b46ff45fc req-db3c8256-d4d7-4817-a76c-da0a33750640 service nova] Creating event network-vif-deleted:8849e2ad-b7bd-40d0-aba9-d512831c8b63 for instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab on hv-cinder-83009 May 10 03:21:06.836220 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-c9dc03e5-5b32-4a26-ab11-2b0b46ff45fc req-db3c8256-d4d7-4817-a76c-da0a33750640 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030187 May 10 03:21:06.836844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 434/869] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:06.924772 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0a8ed224-f2a3-4fbc-9037-02e9e70744a6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:06.925555 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-0a8ed224-f2a3-4fbc-9037-02e9e70744a6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:06.932756 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0a8ed224-f2a3-4fbc-9037-02e9e70744a6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.933310 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0a8ed224-f2a3-4fbc-9037-02e9e70744a6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.934367 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0a8ed224-f2a3-4fbc-9037-02e9e70744a6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.935019 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-0a8ed224-f2a3-4fbc-9037-02e9e70744a6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.941282 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-4f359cf0-bac8-4494-9d17-366a2bb89bac req-236f576b-5efc-4388-be4d-43ce1b9402d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0144796a-ba13-4fb0-b9a6-ce953cbc7b60", "tag": "f02b6a99-10e5-411e-be0e-44e837772e46"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:06.978831 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-4f359cf0-bac8-4494-9d17-366a2bb89bac req-236f576b-5efc-4388-be4d-43ce1b9402d8 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.979279 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-4f359cf0-bac8-4494-9d17-366a2bb89bac req-236f576b-5efc-4388-be4d-43ce1b9402d8 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.025597 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-4f359cf0-bac8-4494-9d17-366a2bb89bac req-236f576b-5efc-4388-be4d-43ce1b9402d8 service nova] Creating event network-changed:f02b6a99-10e5-411e-be0e-44e837772e46 for instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 on hv-cinder-83009 May 10 03:21:07.035573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-4f359cf0-bac8-4494-9d17-366a2bb89bac req-236f576b-5efc-4388-be4d-43ce1b9402d8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105502 May 10 03:21:07.039357 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 435/870] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:21:07.069959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-0a8ed224-f2a3-4fbc-9037-02e9e70744a6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lazy-loading 'services' on Instance uuid 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:21:07.195777 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0a8ed224-f2a3-4fbc-9037-02e9e70744a6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments/a9d19f94-b651-4f4e-a022-0ccda4299ea4" status: 202 len: 0 microversion: 2.1 time: 0.274548 May 10 03:21:07.197642 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 436/871] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:21:06 2022] DELETE /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments/a9d19f94-b651-4f4e-a022-0ccda4299ea4 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:07.210726 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-198929a4-0f09-424f-90b1-866b7cef77d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:07.219843 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-198929a4-0f09-424f-90b1-866b7cef77d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:07.248707 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-198929a4-0f09-424f-90b1-866b7cef77d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.249982 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-198929a4-0f09-424f-90b1-866b7cef77d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.251220 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-198929a4-0f09-424f-90b1-866b7cef77d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.253140 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-198929a4-0f09-424f-90b1-866b7cef77d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.336057 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-198929a4-0f09-424f-90b1-866b7cef77d6 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106787 May 10 03:21:07.350611 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 436/872] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:21:07 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:07.667518 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:07.669275 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:07.689834 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.690367 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.694550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.695809 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.736846 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] HTTP exception thrown: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Request method failure captured: May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab HTTP/1.1 May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediP7oia5fjS4Un7z8iBLReCY8sjD4RVKW9fubFuH9zARx0HDkZplcBvzmD7f-iWAobE7IO2y4KkzXF2Fy8o7HgGMh3DFSovGPdO-rZgKeHCDxSklGi0EEupyEuxzX2cmBYLN2nLEW6UKzlZ_nFyf4uOKxGuLWE_HzIw5Mkna8fow40 May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:07.739012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4149fee898c44c180ae1de15ac9d9da", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4149fee898c44c180ae1de15ac9d9da"}]}] May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: a8a3337faba84d0aa85df4121ffb5cd2 May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:07.741164 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab'} May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:07.742117 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:07.743429 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:07.744628 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Returning 404 to user: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:07.744628 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ec9293a6-c7e0-4a11-9f90-9c4a13efce7c tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 404 len: 111 microversion: 2.20 time: 0.080820 May 10 03:21:07.744628 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 437/873] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:21:07 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:21:07.751222 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fbfaaf36-b02f-4316-919c-a72752039309 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '.version_select at 0x7f1497c35940>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:07.780139 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-fbfaaf36-b02f-4316-919c-a72752039309 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-907909196" status: 204 len: 0 microversion: 2.20 time: 0.033145 May 10 03:21:07.781545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 437/874] 10.222.0.55 () {60 vars in 1258 bytes} [Tue May 10 03:21:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-907909196 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 03:21:08.350455 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c8918988-83b7-4aa7-bffb-5a36fdfd3d13 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:08.351737 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-c8918988-83b7-4aa7-bffb-5a36fdfd3d13 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:08.359587 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c8918988-83b7-4aa7-bffb-5a36fdfd3d13 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.360462 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c8918988-83b7-4aa7-bffb-5a36fdfd3d13 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.361469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c8918988-83b7-4aa7-bffb-5a36fdfd3d13 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.362070 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c8918988-83b7-4aa7-bffb-5a36fdfd3d13 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.415787 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c8918988-83b7-4aa7-bffb-5a36fdfd3d13 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071157 May 10 03:21:08.417078 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 438/875] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:21:08 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:09.428073 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fa3766c5-5bfa-489b-bfae-4c2a0a3ab7e9 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:09.429352 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-fa3766c5-5bfa-489b-bfae-4c2a0a3ab7e9 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:09.439335 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fa3766c5-5bfa-489b-bfae-4c2a0a3ab7e9 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:09.439802 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fa3766c5-5bfa-489b-bfae-4c2a0a3ab7e9 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:09.440753 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fa3766c5-5bfa-489b-bfae-4c2a0a3ab7e9 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:09.441210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fa3766c5-5bfa-489b-bfae-4c2a0a3ab7e9 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:09.474790 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-fa3766c5-5bfa-489b-bfae-4c2a0a3ab7e9 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051073 May 10 03:21:09.475675 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 438/876] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:21:09 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:10.486879 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-900b6da8-d3cf-4a71-8c04-cecfdfd66816 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:10.488376 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-900b6da8-d3cf-4a71-8c04-cecfdfd66816 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:10.496468 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-900b6da8-d3cf-4a71-8c04-cecfdfd66816 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.496990 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-900b6da8-d3cf-4a71-8c04-cecfdfd66816 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.498028 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-900b6da8-d3cf-4a71-8c04-cecfdfd66816 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.498470 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-900b6da8-d3cf-4a71-8c04-cecfdfd66816 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.530961 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-900b6da8-d3cf-4a71-8c04-cecfdfd66816 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048095 May 10 03:21:10.531731 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 439/877] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:21:10 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:10.994933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:10.996602 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.008142 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.008142 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.020603 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.021295 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.065951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] HTTP exception thrown: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Request method failure captured: May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: DELETE /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab HTTP/1.1 May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediP7oia5fjS4Un7z8iBLReCY8sjD4RVKW9fubFuH9zARx0HDkZplcBvzmD7f-iWAobE7IO2y4KkzXF2Fy8o7HgGMh3DFSovGPdO-rZgKeHCDxSklGi0EEupyEuxzX2cmBYLN2nLEW6UKzlZ_nFyf4uOKxGuLWE_HzIw5Mkna8fow40 May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:21:11.067074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4149fee898c44c180ae1de15ac9d9da", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4149fee898c44c180ae1de15ac9d9da"}]}] May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: a8a3337faba84d0aa85df4121ffb5cd2 May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.069004 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab'} May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:11.070058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.071362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:11.074360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Returning 404 to user: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:11.074360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c1d81e38-59ae-4d77-b1bb-4708943c0927 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "DELETE /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 404 len: 111 microversion: 2.20 time: 0.079338 May 10 03:21:11.074360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 439/878] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 10 03:21:10 2022] DELETE /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:21:11.077149 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:11.077757 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.085884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.087008 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.087883 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.088390 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.112820 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] HTTP exception thrown: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Request method failure captured: May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab HTTP/1.1 May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediP7oia5fjS4Un7z8iBLReCY8sjD4RVKW9fubFuH9zARx0HDkZplcBvzmD7f-iWAobE7IO2y4KkzXF2Fy8o7HgGMh3DFSovGPdO-rZgKeHCDxSklGi0EEupyEuxzX2cmBYLN2nLEW6UKzlZ_nFyf4uOKxGuLWE_HzIw5Mkna8fow40 May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:11.114761 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4149fee898c44c180ae1de15ac9d9da", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4149fee898c44c180ae1de15ac9d9da"}]}] May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: a8a3337faba84d0aa85df4121ffb5cd2 May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.116789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab'} May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:11.117762 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. May 10 03:21:11.118959 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.122043 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Returning 404 to user: Instance 26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:11.123157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9f6c37d0-2f90-44c2-a285-b0e53b05cfbd tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab" status: 404 len: 111 microversion: 2.20 time: 0.049900 May 10 03:21:11.124211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 440/879] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:21:11 2022] GET /compute/v2.1/servers/26fdab54-dad5-4b0d-b0f2-2bde8d90e3ab => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 03:21:11.543637 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3d9fa7a7-0901-4aa9-ba77-ae354f2d4c58 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:11.544570 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3d9fa7a7-0901-4aa9-ba77-ae354f2d4c58 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.551787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3d9fa7a7-0901-4aa9-ba77-ae354f2d4c58 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.553305 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3d9fa7a7-0901-4aa9-ba77-ae354f2d4c58 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.554211 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3d9fa7a7-0901-4aa9-ba77-ae354f2d4c58 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.556410 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3d9fa7a7-0901-4aa9-ba77-ae354f2d4c58 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.622877 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3d9fa7a7-0901-4aa9-ba77-ae354f2d4c58 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083166 May 10 03:21:11.624241 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 440/880] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 10 03:21:11 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:21:11.635914 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:11.637583 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.648619 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.649186 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.650581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.651428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.777743 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] HTTP exception thrown: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 is not attached to volume a9d19f94-b651-4f4e-a022-0ccda4299ea4 May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Request method failure captured: May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: DELETE /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments/a9d19f94-b651-4f4e-a022-0ccda4299ea4 HTTP/1.1 May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedmSJCnIHGHWV53eHXXb9eXQGF3LqXDjWkpFk_znoqdIJDO85dzVp73w3Lzg0hl5Qb58hDM0aMuh7BD8TLqPf-STIT3Z0ONO3lm_SpalSMu5mB_QYvhlEV-j_o6coXLr_4Y9GUzWO9vIJThqPkL1sMZgMQjhvvcUvy14LUsTltkqJDk May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: b79f1de979384c108b5ff0427e44e30b May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-TestMinimumBasicScenario-1343155971 May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:11.787884 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b79f1de979384c108b5ff0427e44e30b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b79f1de979384c108b5ff0427e44e30b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b79f1de979384c108b5ff0427e44e30b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b79f1de979384c108b5ff0427e44e30b"}]}] May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-TestMinimumBasicScenario-1343155971 May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: b79f1de979384c108b5ff0427e44e30b May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1343155971 May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-TestMinimumBasicScenario-1343155971-project May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: a18ecdf65b7c42e0aeb44519eaaff743 May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-TestMinimumBasicScenario-1343155971-project May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:11.789399 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 is not attached to volume a9d19f94-b651-4f4e-a022-0ccda4299ea4 May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'server_id': '0144796a-ba13-4fb0-b9a6-ce953cbc7b60', 'id': 'a9d19f94-b651-4f4e-a022-0ccda4299ea4'} May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a9d19f94-b651-4f4e-a022-0ccda4299ea4. May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:11.790483 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 is not attached to volume a9d19f94-b651-4f4e-a022-0ccda4299ea4 May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 is not attached to volume a9d19f94-b651-4f4e-a022-0ccda4299ea4 May 10 03:21:11.791740 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:11.794597 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Returning 404 to user: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 is not attached to volume a9d19f94-b651-4f4e-a022-0ccda4299ea4 {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:11.795478 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-cae1f89c-a488-49b3-8340-61be01f7e276 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments/a9d19f94-b651-4f4e-a022-0ccda4299ea4" status: 404 len: 154 microversion: 2.1 time: 0.165348 May 10 03:21:11.796072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 441/881] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 10 03:21:11 2022] DELETE /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60/os-volume_attachments/a9d19f94-b651-4f4e-a022-0ccda4299ea4 => generated 154 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:21:12.295625 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:12.296312 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:12.303422 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.304358 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.305297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.305746 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.325842 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] HTTP exception thrown: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Request method failure captured: May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: DELETE /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f HTTP/1.1 May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiediP7oia5fjS4Un7z8iBLReCY8sjD4RVKW9fubFuH9zARx0HDkZplcBvzmD7f-iWAobE7IO2y4KkzXF2Fy8o7HgGMh3DFSovGPdO-rZgKeHCDxSklGi0EEupyEuxzX2cmBYLN2nLEW6UKzlZ_nFyf4uOKxGuLWE_HzIw5Mkna8fow40 May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:21:12.327425 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4149fee898c44c180ae1de15ac9d9da", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4149fee898c44c180ae1de15ac9d9da"}]}] May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: a8a3337faba84d0aa85df4121ffb5cd2 May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.329501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f'} May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:12.330684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.332232 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:21:12.335126 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Returning 404 to user: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:12.336483 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a3535719-7412-42c5-a580-ab807faa8515 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 404 len: 111 microversion: 2.20 time: 0.044593 May 10 03:21:12.345856 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:12.351806 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] [instance: 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:12.352749 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 441/882] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 10 03:21:12 2022] DELETE /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:21:12.359152 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.359851 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.361055 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.361648 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.381988 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] HTTP exception thrown: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Request method failure captured: May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f HTTP/1.1 May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiediP7oia5fjS4Un7z8iBLReCY8sjD4RVKW9fubFuH9zARx0HDkZplcBvzmD7f-iWAobE7IO2y4KkzXF2Fy8o7HgGMh3DFSovGPdO-rZgKeHCDxSklGi0EEupyEuxzX2cmBYLN2nLEW6UKzlZ_nFyf4uOKxGuLWE_HzIw5Mkna8fow40 May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:12.383799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4149fee898c44c180ae1de15ac9d9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4149fee898c44c180ae1de15ac9d9da", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4149fee898c44c180ae1de15ac9d9da"}]}] May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: f4149fee898c44c180ae1de15ac9d9da May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-545780805 May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: a8a3337faba84d0aa85df4121ffb5cd2 May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-545780805-project May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.385442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f'} May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:12.386319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. May 10 03:21:12.387600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:12.389793 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] Returning 404 to user: Instance 7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:12.390857 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9ef81581-5e21-435d-990e-ff309e9ce8c8 tempest-AttachVolumeShelveTestJSON-545780805 tempest-AttachVolumeShelveTestJSON-545780805-project] 10.222.0.55 "GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f" status: 404 len: 111 microversion: 2.20 time: 0.048967 May 10 03:21:12.391621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 442/883] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 10 03:21:12 2022] GET /compute/v2.1/servers/7ddc2ff9-b0dc-43a5-99f7-cfbdde39593f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:21:12.982593 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a47a5a94-1a89-4a06-be61-5704cd4d92f4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:12.983245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a47a5a94-1a89-4a06-be61-5704cd4d92f4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:12.992576 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a47a5a94-1a89-4a06-be61-5704cd4d92f4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.993301 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a47a5a94-1a89-4a06-be61-5704cd4d92f4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.994166 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a47a5a94-1a89-4a06-be61-5704cd4d92f4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.994677 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a47a5a94-1a89-4a06-be61-5704cd4d92f4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.025412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a47a5a94-1a89-4a06-be61-5704cd4d92f4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:21:13.132223 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a47a5a94-1a89-4a06-be61-5704cd4d92f4 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 204 len: 0 microversion: 2.1 time: 0.153379 May 10 03:21:13.133955 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 442/884] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:21:12 2022] DELETE /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:21:13.143800 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-59585a7a-5578-4216-9f17-b92ed5719f6c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:13.145510 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-59585a7a-5578-4216-9f17-b92ed5719f6c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:13.153605 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-59585a7a-5578-4216-9f17-b92ed5719f6c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.154239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-59585a7a-5578-4216-9f17-b92ed5719f6c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.155355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-59585a7a-5578-4216-9f17-b92ed5719f6c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.156026 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-59585a7a-5578-4216-9f17-b92ed5719f6c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.330237 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-59585a7a-5578-4216-9f17-b92ed5719f6c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:13.341079 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-59585a7a-5578-4216-9f17-b92ed5719f6c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1556 microversion: 2.1 time: 0.202897 May 10 03:21:13.341936 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 443/885] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:21:13 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1556 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:14.365658 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0be7bd84-8a72-4436-ae93-798936abb197 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:14.367193 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0be7bd84-8a72-4436-ae93-798936abb197 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:14.382205 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0be7bd84-8a72-4436-ae93-798936abb197 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.382859 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0be7bd84-8a72-4436-ae93-798936abb197 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:14.383651 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0be7bd84-8a72-4436-ae93-798936abb197 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.384092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0be7bd84-8a72-4436-ae93-798936abb197 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:14.805100 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0be7bd84-8a72-4436-ae93-798936abb197 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:14.814872 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0be7bd84-8a72-4436-ae93-798936abb197 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1556 microversion: 2.1 time: 0.457576 May 10 03:21:14.815468 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 443/886] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:21:14 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1556 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:15.666549 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-49f98a7a-ee4f-4c94-885c-ed76b699e18d req-020f7d6f-c684-441f-b882-dc2653f36b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0144796a-ba13-4fb0-b9a6-ce953cbc7b60", "name": "network-vif-deleted", "tag": "f02b6a99-10e5-411e-be0e-44e837772e46"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:15.675611 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-49f98a7a-ee4f-4c94-885c-ed76b699e18d req-020f7d6f-c684-441f-b882-dc2653f36b35 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:15.676436 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-49f98a7a-ee4f-4c94-885c-ed76b699e18d req-020f7d6f-c684-441f-b882-dc2653f36b35 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:15.690747 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-49f98a7a-ee4f-4c94-885c-ed76b699e18d req-020f7d6f-c684-441f-b882-dc2653f36b35 service nova] Creating event network-vif-deleted:f02b6a99-10e5-411e-be0e-44e837772e46 for instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 on hv-cinder-83009 May 10 03:21:15.697904 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-49f98a7a-ee4f-4c94-885c-ed76b699e18d req-020f7d6f-c684-441f-b882-dc2653f36b35 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034722 May 10 03:21:15.699301 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 444/887] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:15.834262 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f6e789ca-836e-4596-8df1-8beea70bc580 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:15.834911 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f6e789ca-836e-4596-8df1-8beea70bc580 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:15.845967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f6e789ca-836e-4596-8df1-8beea70bc580 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:15.846672 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f6e789ca-836e-4596-8df1-8beea70bc580 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:15.847471 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f6e789ca-836e-4596-8df1-8beea70bc580 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:15.851085 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f6e789ca-836e-4596-8df1-8beea70bc580 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:16.053264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f6e789ca-836e-4596-8df1-8beea70bc580 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18ecdf65b7c42e0aeb44519eaaff743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f1de979384c108b5ff0427e44e30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:16.069621 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f6e789ca-836e-4596-8df1-8beea70bc580 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 200 len: 1344 microversion: 2.1 time: 0.240297 May 10 03:21:16.072416 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 444/888] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:21:15 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 1344 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:17.091536 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:17.093234 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] [instance: 0144796a-ba13-4fb0-b9a6-ce953cbc7b60] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:17.108883 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:17.111799 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:17.112840 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:17.113608 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:17.147402 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] HTTP exception thrown: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 could not be found. May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Request method failure captured: May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 HTTP/1.1 May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedmSJCnIHGHWV53eHXXb9eXQGF3LqXDjWkpFk_znoqdIJDO85dzVp73w3Lzg0hl5Qb58hDM0aMuh7BD8TLqPf-STIT3Z0ONO3lm_SpalSMu5mB_QYvhlEV-j_o6coXLr_4Y9GUzWO9vIJThqPkL1sMZgMQjhvvcUvy14LUsTltkqJDk May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: b79f1de979384c108b5ff0427e44e30b May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-TestMinimumBasicScenario-1343155971 May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:17.149437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b79f1de979384c108b5ff0427e44e30b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b79f1de979384c108b5ff0427e44e30b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b79f1de979384c108b5ff0427e44e30b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b79f1de979384c108b5ff0427e44e30b"}]}] May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-TestMinimumBasicScenario-1343155971 May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: b79f1de979384c108b5ff0427e44e30b May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1343155971 May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-TestMinimumBasicScenario-1343155971-project May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: a18ecdf65b7c42e0aeb44519eaaff743 May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-TestMinimumBasicScenario-1343155971-project May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 could not be found. May 10 03:21:17.150816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': '0144796a-ba13-4fb0-b9a6-ce953cbc7b60'} May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 could not be found. May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:17.151671 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 could not be found. May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 could not be found. May 10 03:21:17.152897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:17.157453 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Returning 404 to user: Instance 0144796a-ba13-4fb0-b9a6-ce953cbc7b60 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:17.158693 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4ea3f21d-0b61-41be-8f92-56adc118d475 tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60" status: 404 len: 111 microversion: 2.1 time: 0.073927 May 10 03:21:17.164910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 445/889] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:21:17 2022] GET /compute/v2.1/servers/0144796a-ba13-4fb0-b9a6-ce953cbc7b60 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:21:17.167818 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e1b82054-a6e3-4eb9-9a43-7738f4b53e1c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] Calling method '.version_select at 0x7f1497d140d0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:17.202110 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e1b82054-a6e3-4eb9-9a43-7738f4b53e1c tempest-TestMinimumBasicScenario-1343155971 tempest-TestMinimumBasicScenario-1343155971-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1398399798" status: 202 len: 0 microversion: 2.1 time: 0.037908 May 10 03:21:17.214524 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 445/890] 10.222.0.55 () {58 vars in 1271 bytes} [Tue May 10 03:21:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1398399798 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:20.362516 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a4a4aaed-608c-4c15-a430-76fb77053118 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] Action: 'create', calling method: .version_select at 0x7f14a44f5d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1191313448", "metadata": {"Type": "work"}}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:20.757676 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a4a4aaed-608c-4c15-a430-76fb77053118 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.670280 May 10 03:21:20.759187 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 446/891] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 10 03:21:20 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 672 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 03:21:20.778085 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-63c5eb0e-612d-4815-98dd-513732d1cc22 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] Calling method '.version_select at 0x7f1497d73670>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:20.871132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-63c5eb0e-612d-4815-98dd-513732d1cc22 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c" status: 200 len: 353 microversion: 2.1 time: 0.101691 May 10 03:21:20.872036 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 446/892] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:21:20 2022] GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:21.885577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-68b267bd-bd49-47e0-921c-b97d60b6b2ee tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] Calling method '.version_select at 0x7f14a4464820>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:21.944534 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-68b267bd-bd49-47e0-921c-b97d60b6b2ee tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c" status: 200 len: 354 microversion: 2.1 time: 0.065095 May 10 03:21:21.946016 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 447/893] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:21:21 2022] GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:21.958057 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-50a85035-6717-4cd2-8512-49f7511f75ed tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] Calling method '.version_select at 0x7f1497eee1f0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:22.035491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-50a85035-6717-4cd2-8512-49f7511f75ed tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c" status: 200 len: 354 microversion: 2.1 time: 0.082798 May 10 03:21:22.036461 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 447/894] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:21:21 2022] GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:22.056770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8d6e2f48-7329-4800-9e9a-4c316adb3a05 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] Calling method '.version_select at 0x7f14a4497d30>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:22.167855 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8d6e2f48-7329-4800-9e9a-4c316adb3a05 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c" status: 202 len: 0 microversion: 2.1 time: 0.117830 May 10 03:21:22.171600 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 448/895] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:21:22 2022] DELETE /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:22.177703 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a5d61c80-1a38-4dcd-8a02-de43f381d7cb tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] Calling method '.version_select at 0x7f1497d73ee0>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:22.264598 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a5d61c80-1a38-4dcd-8a02-de43f381d7cb tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c" status: 200 len: 353 microversion: 2.1 time: 0.091140 May 10 03:21:22.265181 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 448/896] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:21:22 2022] GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:23.277583 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d6ab30b7-223b-4404-9093-d9faa81cb734 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] Calling method '.version_select at 0x7f14a4535c10>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:23.308583 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-d6ab30b7-223b-4404-9093-d9faa81cb734 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] HTTP exception thrown: Volume f6e63496-7ffd-4ec6-8f74-e18b6468a70c could not be found. May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d6ab30b7-223b-4404-9093-d9faa81cb734 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] Request method failure captured: May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c HTTP/1.1 May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABiedovWFzr6lgkb1Kme9--sK2RIgG8bNMuve1SnSwdwA_MH6m_q1gK1-Y8PozOugJcsld_Cjlsc8KGpoDMQtOhW4ekqnT2vQUDsYHixuwsvnohX-h7zD1hM2V0B0XGE_qiroDAGXkNZOflFmJBpcEWG0BYRnAKHL2tDDzTrF_xgKyPoTA May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: 982eecb51f594c6faa0a96eefdee92c0 May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-VolumesGetTestJSON-189234780 May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:21:23.310564 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/982eecb51f594c6faa0a96eefdee92c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/982eecb51f594c6faa0a96eefdee92c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_982eecb51f594c6faa0a96eefdee92c0", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/982eecb51f594c6faa0a96eefdee92c0"}]}] May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-VolumesGetTestJSON-189234780 May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: 982eecb51f594c6faa0a96eefdee92c0 May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-VolumesGetTestJSON-189234780 May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-VolumesGetTestJSON-189234780-project May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: e6c3ffb33b4f42a6b36f6a36179d6c2d May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-VolumesGetTestJSON-189234780-project May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Volume f6e63496-7ffd-4ec6-8f74-e18b6468a70c could not be found. May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': 'f6e63496-7ffd-4ec6-8f74-e18b6468a70c'} May 10 03:21:23.312095 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6e63496-7ffd-4ec6-8f74-e18b6468a70c could not be found. (HTTP 404) (Request-ID: req-baec8bf2-9695-47b0-adc6-1ecbc3bb7d58) May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:23.314266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:21:23.316643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6e63496-7ffd-4ec6-8f74-e18b6468a70c could not be found. May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 03:21:23.321727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6e63496-7ffd-4ec6-8f74-e18b6468a70c could not be found. May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6e63496-7ffd-4ec6-8f74-e18b6468a70c could not be found. May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d6ab30b7-223b-4404-9093-d9faa81cb734 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] Returning 404 to user: Volume f6e63496-7ffd-4ec6-8f74-e18b6468a70c could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d6ab30b7-223b-4404-9093-d9faa81cb734 tempest-VolumesGetTestJSON-189234780 tempest-VolumesGetTestJSON-189234780-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c" status: 404 len: 109 microversion: 2.1 time: 0.038762 May 10 03:21:23.323520 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 449/897] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 10 03:21:23 2022] GET /compute/v2.1/os-volumes/f6e63496-7ffd-4ec6-8f74-e18b6468a70c => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:22:01.161162 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2077053833", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "networks": [{"uuid": "77909717-f34e-49c1-add8-149322101461"}]}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:01.212100 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.network.neutron [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] validate_networks() for [('77909717-f34e-49c1-add8-149322101461', None, None, None, None, None)] {{(pid=117120) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:22:01.602173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Flavor limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:22:01.602597 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Image limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:22:01.603071 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Flavor pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:22:01.603616 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Image pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:22:01.604031 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:22:01.612966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:01.613436 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:01.614230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:01.614656 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:01.631215 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Getting quotas for project c224356accca4d1bbf7a2440aa0d9b89. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:22:01.635049 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Getting quotas for user b862c7d5db4749879a441b2a90621d7c and project c224356accca4d1bbf7a2440aa0d9b89. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:22:01.646240 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Going to run 1 instances... {{(pid=117120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:22:01.648443 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:22:01.691511 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [54f7269f-d2d6-4f33-adb4-15c345c7fb8a] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:22:02.699504 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [54f7269f-d2d6-4f33-adb4-15c345c7fb8a] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 43400. May 10 03:22:02.704317 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f7c03f49-5fcb-4f4e-97c0-8a002bf20232 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547801 May 10 03:22:02.705084 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 449/898] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:22:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:22:02.716499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-166ce5d3-1242-40db-9176-98d6d162abe9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:02.718438 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-166ce5d3-1242-40db-9176-98d6d162abe9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:02.779342 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-166ce5d3-1242-40db-9176-98d6d162abe9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:02.786319 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-166ce5d3-1242-40db-9176-98d6d162abe9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1214 microversion: 2.1 time: 0.074982 May 10 03:22:02.787504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 450/899] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:02 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:03.803736 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-160efcea-4c04-4b36-8594-6c760fba569c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:03.804376 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-160efcea-4c04-4b36-8594-6c760fba569c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:03.813609 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-160efcea-4c04-4b36-8594-6c760fba569c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.814062 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-160efcea-4c04-4b36-8594-6c760fba569c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.817417 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-160efcea-4c04-4b36-8594-6c760fba569c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.818059 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-160efcea-4c04-4b36-8594-6c760fba569c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.888166 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-160efcea-4c04-4b36-8594-6c760fba569c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:03.897688 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-160efcea-4c04-4b36-8594-6c760fba569c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1272 microversion: 2.1 time: 0.098338 May 10 03:22:03.904718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 450/900] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:03 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:04.915630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b7da82a3-d20b-4497-9c8f-148d39bc4191 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:04.916242 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b7da82a3-d20b-4497-9c8f-148d39bc4191 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:04.922828 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b7da82a3-d20b-4497-9c8f-148d39bc4191 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.923282 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b7da82a3-d20b-4497-9c8f-148d39bc4191 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.924066 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b7da82a3-d20b-4497-9c8f-148d39bc4191 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.924499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b7da82a3-d20b-4497-9c8f-148d39bc4191 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.037998 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-8c239e81-d9da-4e0e-8925-e84fae916034 req-84e61752-91bd-4687-a67d-1df2451df091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd99d36-618e-451a-bba6-b7bd4a1351e2", "tag": "8a81cf29-967f-4ca0-97da-1fe630460d8a"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:05.066173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-8c239e81-d9da-4e0e-8925-e84fae916034 req-84e61752-91bd-4687-a67d-1df2451df091 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.066173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-8c239e81-d9da-4e0e-8925-e84fae916034 req-84e61752-91bd-4687-a67d-1df2451df091 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.081318 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-8c239e81-d9da-4e0e-8925-e84fae916034 req-84e61752-91bd-4687-a67d-1df2451df091 service nova] Creating event network-changed:8a81cf29-967f-4ca0-97da-1fe630460d8a for instance cfd99d36-618e-451a-bba6-b7bd4a1351e2 on hv-cinder-83009 May 10 03:22:05.087694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-8c239e81-d9da-4e0e-8925-e84fae916034 req-84e61752-91bd-4687-a67d-1df2451df091 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054625 May 10 03:22:05.088501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 451/901] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:22:05.197391 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b7da82a3-d20b-4497-9c8f-148d39bc4191 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:05.205438 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b7da82a3-d20b-4497-9c8f-148d39bc4191 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.293567 May 10 03:22:05.206238 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 451/902] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:04 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:06.222534 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a49698d0-5225-4b15-b964-0fe693e7e6cd tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:06.223989 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a49698d0-5225-4b15-b964-0fe693e7e6cd tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:06.231701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a49698d0-5225-4b15-b964-0fe693e7e6cd tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:06.232325 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a49698d0-5225-4b15-b964-0fe693e7e6cd tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:06.233238 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a49698d0-5225-4b15-b964-0fe693e7e6cd tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:06.234455 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a49698d0-5225-4b15-b964-0fe693e7e6cd tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:06.378370 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a49698d0-5225-4b15-b964-0fe693e7e6cd tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:06.386598 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a49698d0-5225-4b15-b964-0fe693e7e6cd tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.168644 May 10 03:22:06.387289 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 452/903] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:06 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:07.404278 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b706dc38-60bb-4363-8732-d4e05a27349e tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:07.405083 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b706dc38-60bb-4363-8732-d4e05a27349e tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:07.411701 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b706dc38-60bb-4363-8732-d4e05a27349e tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.412144 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b706dc38-60bb-4363-8732-d4e05a27349e tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.412931 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b706dc38-60bb-4363-8732-d4e05a27349e tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.413361 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b706dc38-60bb-4363-8732-d4e05a27349e tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.538303 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b706dc38-60bb-4363-8732-d4e05a27349e tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:07.545455 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b706dc38-60bb-4363-8732-d4e05a27349e tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.145188 May 10 03:22:07.546120 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 452/904] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:07 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:08.562558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-dbec2a26-44e4-4b20-ba97-af3ef27dd468 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:08.563117 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-dbec2a26-44e4-4b20-ba97-af3ef27dd468 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:08.569515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dbec2a26-44e4-4b20-ba97-af3ef27dd468 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.569963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dbec2a26-44e4-4b20-ba97-af3ef27dd468 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.570732 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dbec2a26-44e4-4b20-ba97-af3ef27dd468 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.571169 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-dbec2a26-44e4-4b20-ba97-af3ef27dd468 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.699011 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-dbec2a26-44e4-4b20-ba97-af3ef27dd468 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:08.707241 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-dbec2a26-44e4-4b20-ba97-af3ef27dd468 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.148937 May 10 03:22:08.707806 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 453/905] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:08 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:09.723735 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-84462319-531d-4f68-83ea-0be6a9e6b0c1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:09.724368 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-84462319-531d-4f68-83ea-0be6a9e6b0c1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:09.730715 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-84462319-531d-4f68-83ea-0be6a9e6b0c1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.731165 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-84462319-531d-4f68-83ea-0be6a9e6b0c1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.731945 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-84462319-531d-4f68-83ea-0be6a9e6b0c1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.732570 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-84462319-531d-4f68-83ea-0be6a9e6b0c1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.865643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-84462319-531d-4f68-83ea-0be6a9e6b0c1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:09.872930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-84462319-531d-4f68-83ea-0be6a9e6b0c1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.153020 May 10 03:22:09.873767 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 453/906] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:09 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:10.890342 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a60b9657-86fd-478e-8cd2-f2569dfcad81 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:10.891361 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a60b9657-86fd-478e-8cd2-f2569dfcad81 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:10.897143 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a60b9657-86fd-478e-8cd2-f2569dfcad81 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:10.897588 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a60b9657-86fd-478e-8cd2-f2569dfcad81 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:10.898394 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a60b9657-86fd-478e-8cd2-f2569dfcad81 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:10.898841 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a60b9657-86fd-478e-8cd2-f2569dfcad81 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.058757 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a60b9657-86fd-478e-8cd2-f2569dfcad81 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:11.068906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a60b9657-86fd-478e-8cd2-f2569dfcad81 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.183025 May 10 03:22:11.069497 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 454/907] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:10 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:11.545382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-96078316-bf9e-4ee3-87c0-36a284a97ff2 req-1922f99a-3a49-47f7-89f9-ac486da4d259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd99d36-618e-451a-bba6-b7bd4a1351e2", "name": "network-vif-plugged", "status": "completed", "tag": "8a81cf29-967f-4ca0-97da-1fe630460d8a"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:11.554210 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-96078316-bf9e-4ee3-87c0-36a284a97ff2 req-1922f99a-3a49-47f7-89f9-ac486da4d259 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:11.554656 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-96078316-bf9e-4ee3-87c0-36a284a97ff2 req-1922f99a-3a49-47f7-89f9-ac486da4d259 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.565943 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-96078316-bf9e-4ee3-87c0-36a284a97ff2 req-1922f99a-3a49-47f7-89f9-ac486da4d259 service nova] Creating event network-vif-plugged:8a81cf29-967f-4ca0-97da-1fe630460d8a for instance cfd99d36-618e-451a-bba6-b7bd4a1351e2 on hv-cinder-83009 May 10 03:22:11.570985 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-96078316-bf9e-4ee3-87c0-36a284a97ff2 req-1922f99a-3a49-47f7-89f9-ac486da4d259 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029606 May 10 03:22:11.571754 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 454/908] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:12.085843 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5f86d7f3-27c2-4b84-ae3d-ea2d1139d67f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.086457 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5f86d7f3-27c2-4b84-ae3d-ea2d1139d67f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:12.093640 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f86d7f3-27c2-4b84-ae3d-ea2d1139d67f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.093877 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f86d7f3-27c2-4b84-ae3d-ea2d1139d67f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.094645 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f86d7f3-27c2-4b84-ae3d-ea2d1139d67f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.095084 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5f86d7f3-27c2-4b84-ae3d-ea2d1139d67f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.219853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5f86d7f3-27c2-4b84-ae3d-ea2d1139d67f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.227629 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5f86d7f3-27c2-4b84-ae3d-ea2d1139d67f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.145674 May 10 03:22:12.228200 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 455/909] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:13.245404 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5f302435-7b6b-4a2c-969a-757f6511d990 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:13.246137 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5f302435-7b6b-4a2c-969a-757f6511d990 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:13.252517 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5f302435-7b6b-4a2c-969a-757f6511d990 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.253012 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5f302435-7b6b-4a2c-969a-757f6511d990 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.253783 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5f302435-7b6b-4a2c-969a-757f6511d990 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.254243 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5f302435-7b6b-4a2c-969a-757f6511d990 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.382701 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5f302435-7b6b-4a2c-969a-757f6511d990 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:13.390040 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5f302435-7b6b-4a2c-969a-757f6511d990 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.149147 May 10 03:22:13.390591 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 455/910] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:13 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:14.407829 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-954238f9-762a-453c-bf8a-5a04806fbf18 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:14.408395 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-954238f9-762a-453c-bf8a-5a04806fbf18 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:14.414707 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-954238f9-762a-453c-bf8a-5a04806fbf18 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:14.415138 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-954238f9-762a-453c-bf8a-5a04806fbf18 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:14.415920 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-954238f9-762a-453c-bf8a-5a04806fbf18 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:14.416521 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-954238f9-762a-453c-bf8a-5a04806fbf18 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:14.549770 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-954238f9-762a-453c-bf8a-5a04806fbf18 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:14.556968 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-954238f9-762a-453c-bf8a-5a04806fbf18 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.154046 May 10 03:22:14.557532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 456/911] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:14 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:15.573896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-22c410d1-24f7-4adb-b091-9c3c238d9fce tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:15.574438 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-22c410d1-24f7-4adb-b091-9c3c238d9fce tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:15.581365 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-22c410d1-24f7-4adb-b091-9c3c238d9fce tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:15.581816 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-22c410d1-24f7-4adb-b091-9c3c238d9fce tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:15.582589 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-22c410d1-24f7-4adb-b091-9c3c238d9fce tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:15.583023 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-22c410d1-24f7-4adb-b091-9c3c238d9fce tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:15.713394 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-22c410d1-24f7-4adb-b091-9c3c238d9fce tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:15.720546 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-22c410d1-24f7-4adb-b091-9c3c238d9fce tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1314 microversion: 2.1 time: 0.150779 May 10 03:22:15.721147 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 456/912] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:15 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:16.737596 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-53bd9757-4126-47af-ae31-d9dd5be8a5c3 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:16.738209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-53bd9757-4126-47af-ae31-d9dd5be8a5c3 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:16.744573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-53bd9757-4126-47af-ae31-d9dd5be8a5c3 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.745054 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-53bd9757-4126-47af-ae31-d9dd5be8a5c3 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:16.745819 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-53bd9757-4126-47af-ae31-d9dd5be8a5c3 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.746256 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-53bd9757-4126-47af-ae31-d9dd5be8a5c3 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:16.873145 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-53bd9757-4126-47af-ae31-d9dd5be8a5c3 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:16.880339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-53bd9757-4126-47af-ae31-d9dd5be8a5c3 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1497 microversion: 2.1 time: 0.146831 May 10 03:22:16.880933 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 457/913] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:16 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:18.988330 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3341ee76-6dc2-4804-957e-92e23c12d8b7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:18.988868 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3341ee76-6dc2-4804-957e-92e23c12d8b7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:18.995108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3341ee76-6dc2-4804-957e-92e23c12d8b7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.995577 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3341ee76-6dc2-4804-957e-92e23c12d8b7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.996384 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3341ee76-6dc2-4804-957e-92e23c12d8b7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.996834 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3341ee76-6dc2-4804-957e-92e23c12d8b7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:19.021870 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3341ee76-6dc2-4804-957e-92e23c12d8b7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:22:19.097810 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3341ee76-6dc2-4804-957e-92e23c12d8b7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 204 len: 0 microversion: 2.1 time: 0.112952 May 10 03:22:19.098401 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 457/914] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:22:18 2022] DELETE /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:22:19.106562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c19f18a8-66f5-4471-b196-f3e761de4fcb tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:19.107366 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c19f18a8-66f5-4471-b196-f3e761de4fcb tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:19.114727 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c19f18a8-66f5-4471-b196-f3e761de4fcb tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:19.115296 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c19f18a8-66f5-4471-b196-f3e761de4fcb tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:19.116138 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c19f18a8-66f5-4471-b196-f3e761de4fcb tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:19.116687 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c19f18a8-66f5-4471-b196-f3e761de4fcb tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:19.253041 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c19f18a8-66f5-4471-b196-f3e761de4fcb tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:19.260238 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c19f18a8-66f5-4471-b196-f3e761de4fcb tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1503 microversion: 2.1 time: 0.157657 May 10 03:22:19.260824 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 458/915] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:19 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:20.277343 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d49cf7e3-3a76-4f27-81bb-2e172b3b7f8c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:20.278051 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d49cf7e3-3a76-4f27-81bb-2e172b3b7f8c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:20.284684 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d49cf7e3-3a76-4f27-81bb-2e172b3b7f8c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:20.285216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d49cf7e3-3a76-4f27-81bb-2e172b3b7f8c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:20.285997 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d49cf7e3-3a76-4f27-81bb-2e172b3b7f8c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:20.286435 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d49cf7e3-3a76-4f27-81bb-2e172b3b7f8c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:20.424615 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d49cf7e3-3a76-4f27-81bb-2e172b3b7f8c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:20.432094 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d49cf7e3-3a76-4f27-81bb-2e172b3b7f8c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1503 microversion: 2.1 time: 0.159072 May 10 03:22:20.432872 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 458/916] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:20 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:20.930054 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-249c1964-575e-4e82-b5af-782cef7a68d4 req-c2181a39-4981-4c71-be82-b841f4a776f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd99d36-618e-451a-bba6-b7bd4a1351e2", "name": "network-vif-deleted", "tag": "8a81cf29-967f-4ca0-97da-1fe630460d8a"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:20.939826 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-249c1964-575e-4e82-b5af-782cef7a68d4 req-c2181a39-4981-4c71-be82-b841f4a776f3 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:20.940294 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-249c1964-575e-4e82-b5af-782cef7a68d4 req-c2181a39-4981-4c71-be82-b841f4a776f3 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:20.950891 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-249c1964-575e-4e82-b5af-782cef7a68d4 req-c2181a39-4981-4c71-be82-b841f4a776f3 service nova] Creating event network-vif-deleted:8a81cf29-967f-4ca0-97da-1fe630460d8a for instance cfd99d36-618e-451a-bba6-b7bd4a1351e2 on hv-cinder-83009 May 10 03:22:20.956287 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-249c1964-575e-4e82-b5af-782cef7a68d4 req-c2181a39-4981-4c71-be82-b841f4a776f3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030115 May 10 03:22:20.956900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 459/917] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:21.449647 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a8c9c09c-84d4-4c5b-a417-0ec9e46d9258 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:21.450266 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a8c9c09c-84d4-4c5b-a417-0ec9e46d9258 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:21.456923 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8c9c09c-84d4-4c5b-a417-0ec9e46d9258 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:21.457378 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8c9c09c-84d4-4c5b-a417-0ec9e46d9258 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:21.458151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8c9c09c-84d4-4c5b-a417-0ec9e46d9258 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:21.458593 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8c9c09c-84d4-4c5b-a417-0ec9e46d9258 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:21.523271 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a8c9c09c-84d4-4c5b-a417-0ec9e46d9258 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:21.531460 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a8c9c09c-84d4-4c5b-a417-0ec9e46d9258 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1461 microversion: 2.1 time: 0.085664 May 10 03:22:21.532025 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 459/918] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:21 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:22.548123 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-899ddf5b-9b9f-40ad-a503-d3864c09fe41 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:22.548901 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-899ddf5b-9b9f-40ad-a503-d3864c09fe41 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:22.555057 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-899ddf5b-9b9f-40ad-a503-d3864c09fe41 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:22.555507 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-899ddf5b-9b9f-40ad-a503-d3864c09fe41 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:22.556277 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-899ddf5b-9b9f-40ad-a503-d3864c09fe41 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:22.556746 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-899ddf5b-9b9f-40ad-a503-d3864c09fe41 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:22.616960 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-899ddf5b-9b9f-40ad-a503-d3864c09fe41 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:22.624781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-899ddf5b-9b9f-40ad-a503-d3864c09fe41 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1299 microversion: 2.1 time: 0.080703 May 10 03:22:22.625344 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 460/919] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:22 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:23.641091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:23.642275 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:23.649806 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:23.650254 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:23.651072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:23.651754 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:23.685974 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:23.687285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:23.687807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lazy-loading 'fault' on Instance uuid cfd99d36-618e-451a-bba6-b7bd4a1351e2 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:22:23.743992 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:23.755013 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-dc5e08c0-a284-4e91-a861-e725a8319e93 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 200 len: 1304 microversion: 2.1 time: 0.117770 May 10 03:22:23.755683 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 460/920] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:23 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:24.772046 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:24.772772 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: cfd99d36-618e-451a-bba6-b7bd4a1351e2] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:24.779473 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:24.780270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:24.781242 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:24.782022 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:24.796276 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] HTTP exception thrown: Instance cfd99d36-618e-451a-bba6-b7bd4a1351e2 could not be found. May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Request method failure captured: May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 HTTP/1.1 May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedpXHLw-OBPoYpMrUKXKovEELgYnVBxMH0EUEAOYE2TypzaGxVrXWZen9CYIx8zyy2k-WLj0ndVHOZWw_W5OPWu6mfY7vBmBdEooyIZXa4ErY6CIDkWpGok8kQqtwWJIpjoOfbu_BDzgepz6V_CNmcqElY0HvPtBYD3lr8yQL2_F1kQ May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: c224356accca4d1bbf7a2440aa0d9b89 May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-VolumesActionsTest-1364936115 May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:22:24.797962 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c224356accca4d1bbf7a2440aa0d9b89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c224356accca4d1bbf7a2440aa0d9b89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c224356accca4d1bbf7a2440aa0d9b89", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c224356accca4d1bbf7a2440aa0d9b89"}]}] May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-VolumesActionsTest-1364936115 May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: c224356accca4d1bbf7a2440aa0d9b89 May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-VolumesActionsTest-1364936115 May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-VolumesActionsTest-1364936115-project May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: b862c7d5db4749879a441b2a90621d7c May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-VolumesActionsTest-1364936115-project May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance cfd99d36-618e-451a-bba6-b7bd4a1351e2 could not be found. May 10 03:22:24.799655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': 'cfd99d36-618e-451a-bba6-b7bd4a1351e2'} May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfd99d36-618e-451a-bba6-b7bd4a1351e2 could not be found. May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:22:24.800501 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfd99d36-618e-451a-bba6-b7bd4a1351e2 could not be found. May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfd99d36-618e-451a-bba6-b7bd4a1351e2 could not be found. May 10 03:22:24.801832 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:24.802988 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Returning 404 to user: Instance cfd99d36-618e-451a-bba6-b7bd4a1351e2 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:22:24.802988 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-899fb70a-0d60-4fa3-a269-2677dd402c1c tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2" status: 404 len: 111 microversion: 2.1 time: 0.031349 May 10 03:22:24.802988 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 461/921] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:24 2022] GET /compute/v2.1/servers/cfd99d36-618e-451a-bba6-b7bd4a1351e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:22:24.894270 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-436975769", "imageRef": "3dbc5208-7cb9-4543-8367-688206bbfa93", "flavorRef": "452", "networks": [{"uuid": "77909717-f34e-49c1-add8-149322101461"}]}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:24.958709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] validate_networks() for [('77909717-f34e-49c1-add8-149322101461', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:22:25.290108 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:22:25.290533 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:22:25.291039 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:22:25.291470 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:22:25.291885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:22:25.300947 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:25.301396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:25.302200 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:25.302641 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:25.319881 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Getting quotas for project c224356accca4d1bbf7a2440aa0d9b89. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:22:25.323717 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Getting quotas for user b862c7d5db4749879a441b2a90621d7c and project c224356accca4d1bbf7a2440aa0d9b89. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:22:25.335517 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:22:25.337775 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dbc5208-7cb9-4543-8367-688206bbfa93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:22:25.382398 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-26bb5317-ed1d-4493-bcfa-8789533f0478 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492049 May 10 03:22:25.383039 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 461/922] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:22:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:22:25.393523 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b00d63fb-bed3-43e8-8eab-6656f9afa15f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:25.394403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b00d63fb-bed3-43e8-8eab-6656f9afa15f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:25.449505 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b00d63fb-bed3-43e8-8eab-6656f9afa15f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:25.458442 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b00d63fb-bed3-43e8-8eab-6656f9afa15f tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1213 microversion: 2.1 time: 0.069435 May 10 03:22:25.459018 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 462/923] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:25 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:26.475609 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fd1d117f-54c3-4b85-b8ac-21473be05643 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:26.476224 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fd1d117f-54c3-4b85-b8ac-21473be05643 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:26.482367 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fd1d117f-54c3-4b85-b8ac-21473be05643 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:26.482817 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fd1d117f-54c3-4b85-b8ac-21473be05643 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:26.484145 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fd1d117f-54c3-4b85-b8ac-21473be05643 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:26.484634 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fd1d117f-54c3-4b85-b8ac-21473be05643 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:26.548581 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-fd1d117f-54c3-4b85-b8ac-21473be05643 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:26.555807 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fd1d117f-54c3-4b85-b8ac-21473be05643 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1217 microversion: 2.1 time: 0.084522 May 10 03:22:26.556372 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 462/924] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:26 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:27.573267 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c7151a5c-be4b-458e-8565-bd885e12cba9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:27.573881 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c7151a5c-be4b-458e-8565-bd885e12cba9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:27.580937 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c7151a5c-be4b-458e-8565-bd885e12cba9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:27.581382 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c7151a5c-be4b-458e-8565-bd885e12cba9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:27.582142 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c7151a5c-be4b-458e-8565-bd885e12cba9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:27.582574 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c7151a5c-be4b-458e-8565-bd885e12cba9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:27.643492 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c7151a5c-be4b-458e-8565-bd885e12cba9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:27.650622 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c7151a5c-be4b-458e-8565-bd885e12cba9 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1209 microversion: 2.1 time: 0.081232 May 10 03:22:27.651182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 463/925] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:27 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:28.667305 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b8aeeb1e-1d16-4f3b-bd3f-36a2045151c7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:28.667997 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b8aeeb1e-1d16-4f3b-bd3f-36a2045151c7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:28.675352 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b8aeeb1e-1d16-4f3b-bd3f-36a2045151c7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:28.675901 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b8aeeb1e-1d16-4f3b-bd3f-36a2045151c7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:28.676771 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b8aeeb1e-1d16-4f3b-bd3f-36a2045151c7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:28.677276 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b8aeeb1e-1d16-4f3b-bd3f-36a2045151c7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:28.894578 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b8aeeb1e-1d16-4f3b-bd3f-36a2045151c7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:28.902666 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b8aeeb1e-1d16-4f3b-bd3f-36a2045151c7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1313 microversion: 2.1 time: 0.239186 May 10 03:22:28.903239 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 463/926] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:28 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:29.472203 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-f8bda651-9d5f-426d-a96a-e624970558d9 req-0474de0f-f42e-4bbb-910c-2fcc21bd5662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9dde58a-1bf5-4faa-b41d-169577a02331", "tag": "18746123-0801-423a-b0d9-718e5923503f"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:29.493951 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-f8bda651-9d5f-426d-a96a-e624970558d9 req-0474de0f-f42e-4bbb-910c-2fcc21bd5662 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:29.494415 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-f8bda651-9d5f-426d-a96a-e624970558d9 req-0474de0f-f42e-4bbb-910c-2fcc21bd5662 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:29.507076 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-f8bda651-9d5f-426d-a96a-e624970558d9 req-0474de0f-f42e-4bbb-910c-2fcc21bd5662 service nova] Creating event network-changed:18746123-0801-423a-b0d9-718e5923503f for instance e9dde58a-1bf5-4faa-b41d-169577a02331 on hv-cinder-83009 May 10 03:22:29.512209 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-f8bda651-9d5f-426d-a96a-e624970558d9 req-0474de0f-f42e-4bbb-910c-2fcc21bd5662 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043899 May 10 03:22:29.512934 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 464/927] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:29.919478 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-86a55559-942b-4df8-9a68-18722a62d8d7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:29.920086 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-86a55559-942b-4df8-9a68-18722a62d8d7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:29.926833 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-86a55559-942b-4df8-9a68-18722a62d8d7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:29.927284 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-86a55559-942b-4df8-9a68-18722a62d8d7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:29.928048 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-86a55559-942b-4df8-9a68-18722a62d8d7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:29.928495 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-86a55559-942b-4df8-9a68-18722a62d8d7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:30.057575 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-86a55559-942b-4df8-9a68-18722a62d8d7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:30.066104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-86a55559-942b-4df8-9a68-18722a62d8d7 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1313 microversion: 2.1 time: 0.150471 May 10 03:22:30.066676 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 464/928] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:29 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:31.083888 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e1f2db78-6914-4a00-98f2-5e268673f638 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:31.084588 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e1f2db78-6914-4a00-98f2-5e268673f638 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:31.090740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e1f2db78-6914-4a00-98f2-5e268673f638 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:31.091184 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e1f2db78-6914-4a00-98f2-5e268673f638 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:31.091955 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e1f2db78-6914-4a00-98f2-5e268673f638 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:31.093137 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e1f2db78-6914-4a00-98f2-5e268673f638 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:31.223881 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e1f2db78-6914-4a00-98f2-5e268673f638 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:31.232286 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e1f2db78-6914-4a00-98f2-5e268673f638 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1313 microversion: 2.1 time: 0.153000 May 10 03:22:31.232907 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 465/929] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:31 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:32.255296 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f46d9026-9bae-4ae5-a86b-b387961b62a2 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:32.258573 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f46d9026-9bae-4ae5-a86b-b387961b62a2 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:32.270252 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f46d9026-9bae-4ae5-a86b-b387961b62a2 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:32.270658 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f46d9026-9bae-4ae5-a86b-b387961b62a2 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:32.271454 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f46d9026-9bae-4ae5-a86b-b387961b62a2 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:32.271899 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f46d9026-9bae-4ae5-a86b-b387961b62a2 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:32.414072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f46d9026-9bae-4ae5-a86b-b387961b62a2 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:32.422473 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f46d9026-9bae-4ae5-a86b-b387961b62a2 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1313 microversion: 2.1 time: 0.176609 May 10 03:22:32.423078 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 465/930] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:32 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:33.439843 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e20e718f-cc2c-47de-b43b-0752f3d9b2ed tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:33.440462 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e20e718f-cc2c-47de-b43b-0752f3d9b2ed tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:33.446833 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e20e718f-cc2c-47de-b43b-0752f3d9b2ed tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:33.447313 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e20e718f-cc2c-47de-b43b-0752f3d9b2ed tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:33.448054 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e20e718f-cc2c-47de-b43b-0752f3d9b2ed tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:33.448491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e20e718f-cc2c-47de-b43b-0752f3d9b2ed tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:33.578265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e20e718f-cc2c-47de-b43b-0752f3d9b2ed tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:33.585693 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e20e718f-cc2c-47de-b43b-0752f3d9b2ed tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1313 microversion: 2.1 time: 0.150490 May 10 03:22:33.586267 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 466/931] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:33 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:33.898893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-a8e42040-c74e-4c99-8ce1-3391160287ad req-dd5cd92b-40cd-47cb-8281-efd9b793f451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dde58a-1bf5-4faa-b41d-169577a02331", "name": "network-vif-plugged", "status": "completed", "tag": "18746123-0801-423a-b0d9-718e5923503f"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:33.908702 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-a8e42040-c74e-4c99-8ce1-3391160287ad req-dd5cd92b-40cd-47cb-8281-efd9b793f451 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:33.909151 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-a8e42040-c74e-4c99-8ce1-3391160287ad req-dd5cd92b-40cd-47cb-8281-efd9b793f451 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:33.920177 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-a8e42040-c74e-4c99-8ce1-3391160287ad req-dd5cd92b-40cd-47cb-8281-efd9b793f451 service nova] Creating event network-vif-plugged:18746123-0801-423a-b0d9-718e5923503f for instance e9dde58a-1bf5-4faa-b41d-169577a02331 on hv-cinder-83009 May 10 03:22:33.925477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-a8e42040-c74e-4c99-8ce1-3391160287ad req-dd5cd92b-40cd-47cb-8281-efd9b793f451 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030508 May 10 03:22:33.926073 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 466/932] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:34.602759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5fcc8c0f-b43e-4984-919e-07de5c3853e1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:34.603380 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5fcc8c0f-b43e-4984-919e-07de5c3853e1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:34.613523 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5fcc8c0f-b43e-4984-919e-07de5c3853e1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:34.613969 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5fcc8c0f-b43e-4984-919e-07de5c3853e1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:34.614763 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5fcc8c0f-b43e-4984-919e-07de5c3853e1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:34.615170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5fcc8c0f-b43e-4984-919e-07de5c3853e1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:34.748452 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5fcc8c0f-b43e-4984-919e-07de5c3853e1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:34.756701 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5fcc8c0f-b43e-4984-919e-07de5c3853e1 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1313 microversion: 2.1 time: 0.157727 May 10 03:22:34.757268 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 467/933] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:34 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:35.774675 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-153d9c61-1af7-4fe5-9a08-f29c89425383 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:35.775387 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-153d9c61-1af7-4fe5-9a08-f29c89425383 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:35.781885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-153d9c61-1af7-4fe5-9a08-f29c89425383 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:35.782336 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-153d9c61-1af7-4fe5-9a08-f29c89425383 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:35.783104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-153d9c61-1af7-4fe5-9a08-f29c89425383 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:35.783538 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-153d9c61-1af7-4fe5-9a08-f29c89425383 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:35.918361 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-153d9c61-1af7-4fe5-9a08-f29c89425383 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:35.925870 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-153d9c61-1af7-4fe5-9a08-f29c89425383 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1496 microversion: 2.1 time: 0.155862 May 10 03:22:35.926439 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 467/934] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:35 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:36.341602 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-33e1e5fb-8d18-40f0-a972-0fd470b83cff tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:36.342094 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-33e1e5fb-8d18-40f0-a972-0fd470b83cff tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:36.348307 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-33e1e5fb-8d18-40f0-a972-0fd470b83cff tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:36.348799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-33e1e5fb-8d18-40f0-a972-0fd470b83cff tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:36.349565 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-33e1e5fb-8d18-40f0-a972-0fd470b83cff tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:36.349993 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-33e1e5fb-8d18-40f0-a972-0fd470b83cff tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:36.376205 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-33e1e5fb-8d18-40f0-a972-0fd470b83cff tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:22:36.460013 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-33e1e5fb-8d18-40f0-a972-0fd470b83cff tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 204 len: 0 microversion: 2.1 time: 0.121708 May 10 03:22:36.460777 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 468/935] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:22:36 2022] DELETE /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:22:36.469737 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-28e2041a-c8e2-4230-8258-ba8f174763f4 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:36.470348 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-28e2041a-c8e2-4230-8258-ba8f174763f4 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:36.476308 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28e2041a-c8e2-4230-8258-ba8f174763f4 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:36.476800 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28e2041a-c8e2-4230-8258-ba8f174763f4 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:36.477566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28e2041a-c8e2-4230-8258-ba8f174763f4 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:36.478031 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28e2041a-c8e2-4230-8258-ba8f174763f4 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:36.606423 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-28e2041a-c8e2-4230-8258-ba8f174763f4 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:36.615091 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-28e2041a-c8e2-4230-8258-ba8f174763f4 tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1502 microversion: 2.1 time: 0.150256 May 10 03:22:36.615670 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 468/936] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:36 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:37.632552 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-24946a15-7c97-40d6-aab3-9a8cc2abc0fc tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:37.633275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-24946a15-7c97-40d6-aab3-9a8cc2abc0fc tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:37.639723 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-24946a15-7c97-40d6-aab3-9a8cc2abc0fc tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:37.640170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-24946a15-7c97-40d6-aab3-9a8cc2abc0fc tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:37.640957 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-24946a15-7c97-40d6-aab3-9a8cc2abc0fc tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:37.641385 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-24946a15-7c97-40d6-aab3-9a8cc2abc0fc tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:37.772602 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-24946a15-7c97-40d6-aab3-9a8cc2abc0fc tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b862c7d5db4749879a441b2a90621d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c224356accca4d1bbf7a2440aa0d9b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:37.780027 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-24946a15-7c97-40d6-aab3-9a8cc2abc0fc tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 200 len: 1502 microversion: 2.1 time: 0.151647 May 10 03:22:37.781360 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 469/937] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:37 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:38.358924 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-4251c80a-1d9d-4d0a-865f-3bc94a69b3db req-0bf2b984-fba3-4c2d-bd21-f16c528b3a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dde58a-1bf5-4faa-b41d-169577a02331", "name": "network-vif-deleted", "tag": "18746123-0801-423a-b0d9-718e5923503f"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:38.367571 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-4251c80a-1d9d-4d0a-865f-3bc94a69b3db req-0bf2b984-fba3-4c2d-bd21-f16c528b3a00 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:38.368023 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-4251c80a-1d9d-4d0a-865f-3bc94a69b3db req-0bf2b984-fba3-4c2d-bd21-f16c528b3a00 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:38.379405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-4251c80a-1d9d-4d0a-865f-3bc94a69b3db req-0bf2b984-fba3-4c2d-bd21-f16c528b3a00 service nova] Creating event network-vif-deleted:18746123-0801-423a-b0d9-718e5923503f for instance e9dde58a-1bf5-4faa-b41d-169577a02331 on hv-cinder-83009 May 10 03:22:38.384345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-4251c80a-1d9d-4d0a-865f-3bc94a69b3db req-0bf2b984-fba3-4c2d-bd21-f16c528b3a00 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029748 May 10 03:22:38.385002 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 469/938] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:22:38.798699 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:38.799409 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] [instance: e9dde58a-1bf5-4faa-b41d-169577a02331] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:38.806264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:38.806742 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:38.807512 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:38.808010 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:38.826761 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] HTTP exception thrown: Instance e9dde58a-1bf5-4faa-b41d-169577a02331 could not be found. May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Request method failure captured: May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 HTTP/1.1 May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedpXHLw-OBPoYpMrUKXKovEELgYnVBxMH0EUEAOYE2TypzaGxVrXWZen9CYIx8zyy2k-WLj0ndVHOZWw_W5OPWu6mfY7vBmBdEooyIZXa4ErY6CIDkWpGok8kQqtwWJIpjoOfbu_BDzgepz6V_CNmcqElY0HvPtBYD3lr8yQL2_F1kQ May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: c224356accca4d1bbf7a2440aa0d9b89 May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-VolumesActionsTest-1364936115 May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:22:38.828668 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c224356accca4d1bbf7a2440aa0d9b89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c224356accca4d1bbf7a2440aa0d9b89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c224356accca4d1bbf7a2440aa0d9b89", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c224356accca4d1bbf7a2440aa0d9b89"}]}] May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-VolumesActionsTest-1364936115 May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: c224356accca4d1bbf7a2440aa0d9b89 May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-VolumesActionsTest-1364936115 May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-VolumesActionsTest-1364936115-project May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: b862c7d5db4749879a441b2a90621d7c May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-VolumesActionsTest-1364936115-project May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance e9dde58a-1bf5-4faa-b41d-169577a02331 could not be found. May 10 03:22:38.830320 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': 'e9dde58a-1bf5-4faa-b41d-169577a02331'} May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9dde58a-1bf5-4faa-b41d-169577a02331 could not be found. May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:22:38.831173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9dde58a-1bf5-4faa-b41d-169577a02331 could not be found. May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9dde58a-1bf5-4faa-b41d-169577a02331 could not be found. May 10 03:22:38.832403 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:22:38.833538 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] Returning 404 to user: Instance e9dde58a-1bf5-4faa-b41d-169577a02331 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:22:38.833538 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-30eb62c8-f559-4cc9-8afb-bc2b8733d4aa tempest-VolumesActionsTest-1364936115 tempest-VolumesActionsTest-1364936115-project] 10.222.0.55 "GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331" status: 404 len: 111 microversion: 2.1 time: 0.036170 May 10 03:22:38.833538 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 470/939] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:22:38 2022] GET /compute/v2.1/servers/e9dde58a-1bf5-4faa-b41d-169577a02331 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:23:25.201800 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-098a3d55-e548-47d2-aee6-64ebf86fb899 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Action: 'create', calling method: .version_select at 0x7f14a4413af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-67125290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRNEDZPpqspqU4Ml6ePkJa9K4EsddbkhX0RUIIyfx7zRd0OVJOHYRPbBLFLV7Ot3doNYJ4R1hAXl9e0cuurOosVCUPWZj6fd59zKVUXEaBUMW88ESCbZi1AbXETezZzVg=="}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:25.215872 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-098a3d55-e548-47d2-aee6-64ebf86fb899 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Getting quotas for project d27c98ff77b04578b98906b2f6e6b449. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:25.219696 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-098a3d55-e548-47d2-aee6-64ebf86fb899 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Getting quotas for user b0a2a1e98e494e3992f0524efb235da3 and project d27c98ff77b04578b98906b2f6e6b449. Resources: {'key_pairs'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:25.232167 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR oslo.messaging._drivers.impl_rabbit [None req-098a3d55-e548-47d2-aee6-64ebf86fb899 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [34abf783-204b-47f3-a663-38faab272553] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:23:26.239680 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [None req-098a3d55-e548-47d2-aee6-64ebf86fb899 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [34abf783-204b-47f3-a663-38faab272553] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 44408. May 10 03:23:26.253602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-098a3d55-e548-47d2-aee6-64ebf86fb899 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 1.232369 May 10 03:23:26.254198 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 470/940] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:23:25 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:23:41.266739 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-666120800", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-67125290", "security_groups": [{"name": "tempest-secgroup-smoke-1216034445"}], "networks": [{"uuid": "24cdcaa2-e949-4d25-a5e8-ca34e81085f8"}], "block_device_mapping_v2": [{"uuid": "39904eb5-5131-4fe2-b1ca-51d009f595f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:41.372975 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.network.neutron [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] validate_networks() for [('24cdcaa2-e949-4d25-a5e8-ca34e81085f8', None, None, None, None, None)] {{(pid=117120) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:23:41.718606 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Flavor limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:23:41.719021 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Image limits 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:23:41.719485 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Flavor pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:23:41.719884 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Image pref 0:0:0 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:23:41.720282 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.virt.hardware [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:23:41.729927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:41.730388 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:41.731185 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:41.731613 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:41.748096 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Getting quotas for project d27c98ff77b04578b98906b2f6e6b449. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:41.751878 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Getting quotas for user b0a2a1e98e494e3992f0524efb235da3 and project d27c98ff77b04578b98906b2f6e6b449. Resources: {'ram', 'instances', 'cores'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:41.806603 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Going to run 1 instances... {{(pid=117120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:23:41.809196 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39904eb5-5131-4fe2-b1ca-51d009f595f1',volume_size=None,volume_type=None)] {{(pid=117120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:23:41.930698 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d7e39095-c2a3-4912-8b68-852727f2e9e6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.668735 May 10 03:23:41.931338 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 471/941] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:23:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:23:41.942003 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a1ff4c63-6b79-4537-af7d-506f23179df4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:41.942729 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a1ff4c63-6b79-4537-af7d-506f23179df4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:41.997317 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a1ff4c63-6b79-4537-af7d-506f23179df4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:42.004038 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a1ff4c63-6b79-4537-af7d-506f23179df4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1086 microversion: 2.1 time: 0.066436 May 10 03:23:42.005121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 471/942] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:41 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1086 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:43.022330 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5ea6e525-56c0-4da2-8115-bf97ccd6929f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:43.022956 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5ea6e525-56c0-4da2-8115-bf97ccd6929f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:43.029606 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ea6e525-56c0-4da2-8115-bf97ccd6929f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:43.030066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ea6e525-56c0-4da2-8115-bf97ccd6929f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:43.030843 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ea6e525-56c0-4da2-8115-bf97ccd6929f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:43.031279 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5ea6e525-56c0-4da2-8115-bf97ccd6929f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:43.097686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-5ea6e525-56c0-4da2-8115-bf97ccd6929f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:43.106169 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5ea6e525-56c0-4da2-8115-bf97ccd6929f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1202 microversion: 2.1 time: 0.088275 May 10 03:23:43.106669 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 472/943] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:43 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:44.123436 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-74758d00-b70b-44d0-839d-9be321f0b3e5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:44.123974 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-74758d00-b70b-44d0-839d-9be321f0b3e5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:44.130532 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-74758d00-b70b-44d0-839d-9be321f0b3e5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.130976 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-74758d00-b70b-44d0-839d-9be321f0b3e5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.131739 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-74758d00-b70b-44d0-839d-9be321f0b3e5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.132181 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-74758d00-b70b-44d0-839d-9be321f0b3e5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.347141 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-74758d00-b70b-44d0-839d-9be321f0b3e5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:44.354716 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-74758d00-b70b-44d0-839d-9be321f0b3e5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.235592 May 10 03:23:44.355243 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 472/944] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:44 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:44.469725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-21b1d873-e281-4050-8fb7-77e8afb5c856 req-a6b96584-2e64-4851-8c2e-b5ff366ef497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ae322e-e02d-4c98-bd38-7d6721159d0f", "tag": "e312bad7-40a5-425b-8e16-f9e8a2c718d1"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:44.479886 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-21b1d873-e281-4050-8fb7-77e8afb5c856 req-a6b96584-2e64-4851-8c2e-b5ff366ef497 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.480335 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-21b1d873-e281-4050-8fb7-77e8afb5c856 req-a6b96584-2e64-4851-8c2e-b5ff366ef497 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.491966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-21b1d873-e281-4050-8fb7-77e8afb5c856 req-a6b96584-2e64-4851-8c2e-b5ff366ef497 service nova] Creating event network-changed:e312bad7-40a5-425b-8e16-f9e8a2c718d1 for instance 97ae322e-e02d-4c98-bd38-7d6721159d0f on hv-cinder-83009 May 10 03:23:44.498965 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-21b1d873-e281-4050-8fb7-77e8afb5c856 req-a6b96584-2e64-4851-8c2e-b5ff366ef497 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032777 May 10 03:23:44.499960 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 473/945] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:45.371282 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a8db27f0-ebe8-4cda-9376-e431be337847 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:45.371910 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a8db27f0-ebe8-4cda-9376-e431be337847 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:45.378240 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8db27f0-ebe8-4cda-9376-e431be337847 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:45.378692 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8db27f0-ebe8-4cda-9376-e431be337847 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:45.379467 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8db27f0-ebe8-4cda-9376-e431be337847 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:45.379903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a8db27f0-ebe8-4cda-9376-e431be337847 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:45.609530 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a8db27f0-ebe8-4cda-9376-e431be337847 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:45.616795 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a8db27f0-ebe8-4cda-9376-e431be337847 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.249309 May 10 03:23:45.617380 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 473/946] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:45 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:46.634440 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-755a3dc1-7fe6-4b87-9084-e5b6d22b1366 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:46.635136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-755a3dc1-7fe6-4b87-9084-e5b6d22b1366 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:46.641321 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-755a3dc1-7fe6-4b87-9084-e5b6d22b1366 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:46.641747 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-755a3dc1-7fe6-4b87-9084-e5b6d22b1366 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:46.642505 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-755a3dc1-7fe6-4b87-9084-e5b6d22b1366 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:46.642961 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-755a3dc1-7fe6-4b87-9084-e5b6d22b1366 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:46.773206 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-755a3dc1-7fe6-4b87-9084-e5b6d22b1366 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:46.781012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-755a3dc1-7fe6-4b87-9084-e5b6d22b1366 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.151163 May 10 03:23:46.781585 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 474/947] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:46 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:47.797061 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-acaa611b-9276-4770-a6c9-c3cc55c7879b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:47.797669 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-acaa611b-9276-4770-a6c9-c3cc55c7879b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:47.803925 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-acaa611b-9276-4770-a6c9-c3cc55c7879b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:47.804387 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-acaa611b-9276-4770-a6c9-c3cc55c7879b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:47.805168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-acaa611b-9276-4770-a6c9-c3cc55c7879b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:47.805606 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-acaa611b-9276-4770-a6c9-c3cc55c7879b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:47.938871 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-acaa611b-9276-4770-a6c9-c3cc55c7879b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:47.946168 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-acaa611b-9276-4770-a6c9-c3cc55c7879b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.153078 May 10 03:23:47.946743 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 474/948] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:47 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:48.963225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-85104e84-6b5c-469e-9ba0-7d2ff9cd7841 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:48.963891 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-85104e84-6b5c-469e-9ba0-7d2ff9cd7841 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:48.970325 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-85104e84-6b5c-469e-9ba0-7d2ff9cd7841 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.970769 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-85104e84-6b5c-469e-9ba0-7d2ff9cd7841 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:48.971528 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-85104e84-6b5c-469e-9ba0-7d2ff9cd7841 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.971952 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-85104e84-6b5c-469e-9ba0-7d2ff9cd7841 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:49.101870 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-85104e84-6b5c-469e-9ba0-7d2ff9cd7841 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:49.109346 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-85104e84-6b5c-469e-9ba0-7d2ff9cd7841 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.150173 May 10 03:23:49.109906 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 475/949] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:48 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:50.126320 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-279e93e1-9a70-4423-8222-930fc28d24f1 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:50.126928 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-279e93e1-9a70-4423-8222-930fc28d24f1 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:50.133255 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-279e93e1-9a70-4423-8222-930fc28d24f1 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:50.133709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-279e93e1-9a70-4423-8222-930fc28d24f1 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:50.134464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-279e93e1-9a70-4423-8222-930fc28d24f1 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:50.134897 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-279e93e1-9a70-4423-8222-930fc28d24f1 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:50.264084 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-279e93e1-9a70-4423-8222-930fc28d24f1 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:50.271343 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-279e93e1-9a70-4423-8222-930fc28d24f1 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.149043 May 10 03:23:50.271912 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 475/950] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:50 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:51.288798 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-06bb6a0e-c927-4358-bbfe-5a2fb040b3b9 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:51.289421 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-06bb6a0e-c927-4358-bbfe-5a2fb040b3b9 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:51.296130 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-06bb6a0e-c927-4358-bbfe-5a2fb040b3b9 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:51.296586 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-06bb6a0e-c927-4358-bbfe-5a2fb040b3b9 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:51.297391 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-06bb6a0e-c927-4358-bbfe-5a2fb040b3b9 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:51.297827 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-06bb6a0e-c927-4358-bbfe-5a2fb040b3b9 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:51.423222 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-06bb6a0e-c927-4358-bbfe-5a2fb040b3b9 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:51.430515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-06bb6a0e-c927-4358-bbfe-5a2fb040b3b9 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.145636 May 10 03:23:51.431085 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 476/951] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:51 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:52.447418 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2fe67cbf-2bc1-43ca-b3ae-846a179a353a tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:52.448905 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-2fe67cbf-2bc1-43ca-b3ae-846a179a353a tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:52.455157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fe67cbf-2bc1-43ca-b3ae-846a179a353a tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:52.455606 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fe67cbf-2bc1-43ca-b3ae-846a179a353a tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:52.456382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fe67cbf-2bc1-43ca-b3ae-846a179a353a tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:52.456847 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-2fe67cbf-2bc1-43ca-b3ae-846a179a353a tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:52.582325 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-2fe67cbf-2bc1-43ca-b3ae-846a179a353a tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:52.591175 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2fe67cbf-2bc1-43ca-b3ae-846a179a353a tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.147688 May 10 03:23:52.591747 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 476/952] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:52 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:53.608260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c38acd5a-e75e-45d2-8f00-65146ff05855 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:53.608894 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-c38acd5a-e75e-45d2-8f00-65146ff05855 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:53.615199 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c38acd5a-e75e-45d2-8f00-65146ff05855 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:53.615639 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c38acd5a-e75e-45d2-8f00-65146ff05855 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:53.616398 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c38acd5a-e75e-45d2-8f00-65146ff05855 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:53.616862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-c38acd5a-e75e-45d2-8f00-65146ff05855 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:53.748012 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-c38acd5a-e75e-45d2-8f00-65146ff05855 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:53.755347 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c38acd5a-e75e-45d2-8f00-65146ff05855 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.151663 May 10 03:23:53.755910 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 477/953] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:53 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:54.771288 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-facdc06c-1a06-4ac3-891b-5d035533bc01 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:54.771903 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-facdc06c-1a06-4ac3-891b-5d035533bc01 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:54.779034 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-facdc06c-1a06-4ac3-891b-5d035533bc01 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:54.779491 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-facdc06c-1a06-4ac3-891b-5d035533bc01 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:54.780260 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-facdc06c-1a06-4ac3-891b-5d035533bc01 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:54.780728 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-facdc06c-1a06-4ac3-891b-5d035533bc01 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:54.911345 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-facdc06c-1a06-4ac3-891b-5d035533bc01 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:54.918605 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-facdc06c-1a06-4ac3-891b-5d035533bc01 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.151178 May 10 03:23:54.919178 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 477/954] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:54 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:55.935278 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a6574c72-0056-4e97-8bc4-3132a9a7ca8b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:55.935909 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a6574c72-0056-4e97-8bc4-3132a9a7ca8b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:55.942182 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a6574c72-0056-4e97-8bc4-3132a9a7ca8b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:55.942627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a6574c72-0056-4e97-8bc4-3132a9a7ca8b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:55.943381 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a6574c72-0056-4e97-8bc4-3132a9a7ca8b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:55.943807 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a6574c72-0056-4e97-8bc4-3132a9a7ca8b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:56.072260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a6574c72-0056-4e97-8bc4-3132a9a7ca8b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:56.080900 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a6574c72-0056-4e97-8bc4-3132a9a7ca8b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.149273 May 10 03:23:56.081646 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 478/955] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:55 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:56.191062 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-d0b2aa74-4d37-4c93-a5de-06784fee2b28 req-136156d8-834e-40d2-bd98-9c7de3174176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ae322e-e02d-4c98-bd38-7d6721159d0f", "name": "network-vif-plugged", "status": "completed", "tag": "e312bad7-40a5-425b-8e16-f9e8a2c718d1"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:56.200408 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-d0b2aa74-4d37-4c93-a5de-06784fee2b28 req-136156d8-834e-40d2-bd98-9c7de3174176 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:56.200980 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-d0b2aa74-4d37-4c93-a5de-06784fee2b28 req-136156d8-834e-40d2-bd98-9c7de3174176 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:56.212504 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-d0b2aa74-4d37-4c93-a5de-06784fee2b28 req-136156d8-834e-40d2-bd98-9c7de3174176 service nova] Creating event network-vif-plugged:e312bad7-40a5-425b-8e16-f9e8a2c718d1 for instance 97ae322e-e02d-4c98-bd38-7d6721159d0f on hv-cinder-83009 May 10 03:23:56.218354 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-d0b2aa74-4d37-4c93-a5de-06784fee2b28 req-136156d8-834e-40d2-bd98-9c7de3174176 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031042 May 10 03:23:56.219116 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 478/956] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:57.098379 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2f431082-518e-412b-9002-13476dc7b6d3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:57.098995 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2f431082-518e-412b-9002-13476dc7b6d3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:57.105662 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f431082-518e-412b-9002-13476dc7b6d3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:57.106104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f431082-518e-412b-9002-13476dc7b6d3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:57.106860 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f431082-518e-412b-9002-13476dc7b6d3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:57.107289 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f431082-518e-412b-9002-13476dc7b6d3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:57.232912 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2f431082-518e-412b-9002-13476dc7b6d3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:57.240362 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2f431082-518e-412b-9002-13476dc7b6d3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1258 microversion: 2.1 time: 0.145848 May 10 03:23:57.240953 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 479/957] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:57 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:58.258397 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b9547bb4-e292-47b1-a4fa-0d5c2e9b1a2e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:58.259094 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b9547bb4-e292-47b1-a4fa-0d5c2e9b1a2e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:58.266003 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b9547bb4-e292-47b1-a4fa-0d5c2e9b1a2e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:58.266454 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b9547bb4-e292-47b1-a4fa-0d5c2e9b1a2e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:58.267217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b9547bb4-e292-47b1-a4fa-0d5c2e9b1a2e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:58.267651 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b9547bb4-e292-47b1-a4fa-0d5c2e9b1a2e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:58.397751 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b9547bb4-e292-47b1-a4fa-0d5c2e9b1a2e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:58.405613 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b9547bb4-e292-47b1-a4fa-0d5c2e9b1a2e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1441 microversion: 2.1 time: 0.151864 May 10 03:23:58.406182 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 479/958] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:58 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1441 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:58.421821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4b6511ea-98fa-4a2d-8877-75e4bc0e1796 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:58.422443 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4b6511ea-98fa-4a2d-8877-75e4bc0e1796 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:58.428844 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4b6511ea-98fa-4a2d-8877-75e4bc0e1796 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:58.429297 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4b6511ea-98fa-4a2d-8877-75e4bc0e1796 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:58.430065 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4b6511ea-98fa-4a2d-8877-75e4bc0e1796 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:58.430515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4b6511ea-98fa-4a2d-8877-75e4bc0e1796 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:58.561043 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-4b6511ea-98fa-4a2d-8877-75e4bc0e1796 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:58.568347 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4b6511ea-98fa-4a2d-8877-75e4bc0e1796 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1441 microversion: 2.1 time: 0.150494 May 10 03:23:58.568884 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 480/959] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:23:58 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1441 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:00.256416 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-0f86f1a0-d3a6-4a0d-8012-241959e54a6a req-346ece47-4b78-4359-ac3b-a464616177a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ae322e-e02d-4c98-bd38-7d6721159d0f", "tag": "e312bad7-40a5-425b-8e16-f9e8a2c718d1"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:00.264729 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-0f86f1a0-d3a6-4a0d-8012-241959e54a6a req-346ece47-4b78-4359-ac3b-a464616177a6 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:00.265172 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-0f86f1a0-d3a6-4a0d-8012-241959e54a6a req-346ece47-4b78-4359-ac3b-a464616177a6 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:00.275597 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-0f86f1a0-d3a6-4a0d-8012-241959e54a6a req-346ece47-4b78-4359-ac3b-a464616177a6 service nova] Creating event network-changed:e312bad7-40a5-425b-8e16-f9e8a2c718d1 for instance 97ae322e-e02d-4c98-bd38-7d6721159d0f on hv-cinder-83009 May 10 03:24:00.281422 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-0f86f1a0-d3a6-4a0d-8012-241959e54a6a req-346ece47-4b78-4359-ac3b-a464616177a6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028555 May 10 03:24:00.282415 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 480/960] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:24.804409 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:24:24.805056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Tue May 10 03:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:25:50.950064 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-12446a66-7797-4584-a69e-1b526f53477f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:50.950758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-12446a66-7797-4584-a69e-1b526f53477f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:50.956568 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-12446a66-7797-4584-a69e-1b526f53477f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:50.957041 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-12446a66-7797-4584-a69e-1b526f53477f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:50.957801 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-12446a66-7797-4584-a69e-1b526f53477f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:50.958227 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-12446a66-7797-4584-a69e-1b526f53477f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:50.980761 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.objects.instance [None req-12446a66-7797-4584-a69e-1b526f53477f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lazy-loading 'flavor' on Instance uuid 97ae322e-e02d-4c98-bd38-7d6721159d0f {{(pid=117120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:25:51.051197 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-12446a66-7797-4584-a69e-1b526f53477f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "POST /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f/action" status: 202 len: 0 microversion: 2.1 time: 0.106239 May 10 03:25:51.051786 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 481/961] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:25:50 2022] POST /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:25:51.058222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6498c61f-46b4-40de-926e-55958668e2c9] AMQP server on 10.222.0.55:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 10 03:25:51.062473 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-969e9fd5-c495-4377-a7fa-30a03d6ba69d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:51.063206 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-969e9fd5-c495-4377-a7fa-30a03d6ba69d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:51.071180 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-969e9fd5-c495-4377-a7fa-30a03d6ba69d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:51.071666 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-969e9fd5-c495-4377-a7fa-30a03d6ba69d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:51.072529 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-969e9fd5-c495-4377-a7fa-30a03d6ba69d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:51.072993 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-969e9fd5-c495-4377-a7fa-30a03d6ba69d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:51.263935 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-969e9fd5-c495-4377-a7fa-30a03d6ba69d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:51.271445 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-969e9fd5-c495-4377-a7fa-30a03d6ba69d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.215198 May 10 03:25:51.272017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 481/962] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:25:51 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:52.289543 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-22694650-11d0-4de8-aa3c-5040e714dd75 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:52.290241 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-22694650-11d0-4de8-aa3c-5040e714dd75 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:52.293239 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6bbf5464-76a4-4d4b-a380-8e24d3c3ced2] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 03:25:52.297838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-22694650-11d0-4de8-aa3c-5040e714dd75 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.298281 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-22694650-11d0-4de8-aa3c-5040e714dd75 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.299041 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-22694650-11d0-4de8-aa3c-5040e714dd75 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.299467 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-22694650-11d0-4de8-aa3c-5040e714dd75 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.478077 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-22694650-11d0-4de8-aa3c-5040e714dd75 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:52.485949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-22694650-11d0-4de8-aa3c-5040e714dd75 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.200712 May 10 03:25:52.486504 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 482/963] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:25:52 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:53.502583 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5b89182a-972e-4ac8-bfe1-addc476b87aa tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:53.503199 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5b89182a-972e-4ac8-bfe1-addc476b87aa tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:53.510643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5b89182a-972e-4ac8-bfe1-addc476b87aa tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:53.511092 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5b89182a-972e-4ac8-bfe1-addc476b87aa tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:53.512608 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5b89182a-972e-4ac8-bfe1-addc476b87aa tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:53.513094 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5b89182a-972e-4ac8-bfe1-addc476b87aa tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:53.528965 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [-] [6498c61f-46b4-40de-926e-55958668e2c9] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 44630. May 10 03:25:53.640423 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5b89182a-972e-4ac8-bfe1-addc476b87aa tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:53.647660 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5b89182a-972e-4ac8-bfe1-addc476b87aa tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.148945 May 10 03:25:53.648229 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 482/964] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:25:53 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:54.664764 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0ed6f0dc-50f3-4b00-80fb-dcde8354b44e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:54.665324 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0ed6f0dc-50f3-4b00-80fb-dcde8354b44e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:54.673526 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0ed6f0dc-50f3-4b00-80fb-dcde8354b44e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.673968 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0ed6f0dc-50f3-4b00-80fb-dcde8354b44e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.674727 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0ed6f0dc-50f3-4b00-80fb-dcde8354b44e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.675159 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0ed6f0dc-50f3-4b00-80fb-dcde8354b44e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.680963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] [6bbf5464-76a4-4d4b-a380-8e24d3c3ced2] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 44634. May 10 03:25:54.807854 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0ed6f0dc-50f3-4b00-80fb-dcde8354b44e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:54.815345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0ed6f0dc-50f3-4b00-80fb-dcde8354b44e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.154514 May 10 03:25:54.815920 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 483/965] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:25:54 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:55.833603 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-646fa6e7-6ca6-44d4-b742-3541d603acc6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:55.834210 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-646fa6e7-6ca6-44d4-b742-3541d603acc6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:55.841053 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-646fa6e7-6ca6-44d4-b742-3541d603acc6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.841499 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-646fa6e7-6ca6-44d4-b742-3541d603acc6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.842261 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-646fa6e7-6ca6-44d4-b742-3541d603acc6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.842701 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-646fa6e7-6ca6-44d4-b742-3541d603acc6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.973234 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-646fa6e7-6ca6-44d4-b742-3541d603acc6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:55.981292 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-646fa6e7-6ca6-44d4-b742-3541d603acc6 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.151654 May 10 03:25:55.981990 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 483/966] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:25:55 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:56.998642 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6049d3a4-a08c-4b80-a9b1-364c2af83fe4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:56.999250 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6049d3a4-a08c-4b80-a9b1-364c2af83fe4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:57.005545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6049d3a4-a08c-4b80-a9b1-364c2af83fe4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:57.005990 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6049d3a4-a08c-4b80-a9b1-364c2af83fe4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:57.006745 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6049d3a4-a08c-4b80-a9b1-364c2af83fe4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:57.007173 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6049d3a4-a08c-4b80-a9b1-364c2af83fe4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:57.133698 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-6049d3a4-a08c-4b80-a9b1-364c2af83fe4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:57.141208 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6049d3a4-a08c-4b80-a9b1-364c2af83fe4 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.147172 May 10 03:25:57.141772 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 484/967] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:25:56 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:58.157930 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-465bec11-b7ac-4a6e-ad9a-b9cee4f10908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:58.158587 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-465bec11-b7ac-4a6e-ad9a-b9cee4f10908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:58.165179 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-465bec11-b7ac-4a6e-ad9a-b9cee4f10908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:58.165630 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-465bec11-b7ac-4a6e-ad9a-b9cee4f10908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:58.166398 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-465bec11-b7ac-4a6e-ad9a-b9cee4f10908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:58.166834 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-465bec11-b7ac-4a6e-ad9a-b9cee4f10908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:58.457661 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-465bec11-b7ac-4a6e-ad9a-b9cee4f10908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:58.465137 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-465bec11-b7ac-4a6e-ad9a-b9cee4f10908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.310935 May 10 03:25:58.465699 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 484/968] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:25:58 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:59.482097 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-790346a9-ec93-4fc1-a46b-fba58ccaee9b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:59.482736 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-790346a9-ec93-4fc1-a46b-fba58ccaee9b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:59.489103 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-790346a9-ec93-4fc1-a46b-fba58ccaee9b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.489553 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-790346a9-ec93-4fc1-a46b-fba58ccaee9b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.490323 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-790346a9-ec93-4fc1-a46b-fba58ccaee9b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.490758 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-790346a9-ec93-4fc1-a46b-fba58ccaee9b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.615825 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-790346a9-ec93-4fc1-a46b-fba58ccaee9b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:59.623828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-790346a9-ec93-4fc1-a46b-fba58ccaee9b tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.145921 May 10 03:25:59.624395 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 485/969] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:25:59 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:00.641382 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-df44473c-6b64-49ed-a2e0-7ffae435e952 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:00.641918 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-df44473c-6b64-49ed-a2e0-7ffae435e952 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:00.648287 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-df44473c-6b64-49ed-a2e0-7ffae435e952 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.648764 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-df44473c-6b64-49ed-a2e0-7ffae435e952 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:00.649524 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-df44473c-6b64-49ed-a2e0-7ffae435e952 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.649953 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-df44473c-6b64-49ed-a2e0-7ffae435e952 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:00.776339 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-df44473c-6b64-49ed-a2e0-7ffae435e952 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:00.784380 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-df44473c-6b64-49ed-a2e0-7ffae435e952 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.146826 May 10 03:26:00.784969 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 485/970] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:00 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:01.801321 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b39b9e4b-e837-49a2-9717-127667233708 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:01.801926 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b39b9e4b-e837-49a2-9717-127667233708 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:01.808255 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b39b9e4b-e837-49a2-9717-127667233708 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:01.808740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b39b9e4b-e837-49a2-9717-127667233708 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:01.809512 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b39b9e4b-e837-49a2-9717-127667233708 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:01.809949 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b39b9e4b-e837-49a2-9717-127667233708 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:01.943987 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b39b9e4b-e837-49a2-9717-127667233708 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:01.951448 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b39b9e4b-e837-49a2-9717-127667233708 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.154008 May 10 03:26:01.952014 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 486/971] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:01 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:02.968009 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fabacbae-23c3-416c-9827-e0d456072910 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:02.968615 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-fabacbae-23c3-416c-9827-e0d456072910 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:02.974917 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fabacbae-23c3-416c-9827-e0d456072910 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:02.975363 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fabacbae-23c3-416c-9827-e0d456072910 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:02.976127 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fabacbae-23c3-416c-9827-e0d456072910 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:02.976559 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-fabacbae-23c3-416c-9827-e0d456072910 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:03.106695 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-fabacbae-23c3-416c-9827-e0d456072910 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:03.113940 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fabacbae-23c3-416c-9827-e0d456072910 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.149807 May 10 03:26:03.114495 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 486/972] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:02 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:04.131539 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-609c853f-dae5-466a-89dd-5213480ce3be tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:04.132160 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-609c853f-dae5-466a-89dd-5213480ce3be tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:04.140618 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-609c853f-dae5-466a-89dd-5213480ce3be tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:04.141106 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-609c853f-dae5-466a-89dd-5213480ce3be tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:04.141877 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-609c853f-dae5-466a-89dd-5213480ce3be tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:04.142319 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-609c853f-dae5-466a-89dd-5213480ce3be tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:04.268923 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-609c853f-dae5-466a-89dd-5213480ce3be tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:04.276236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-609c853f-dae5-466a-89dd-5213480ce3be tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1507 microversion: 2.1 time: 0.148628 May 10 03:26:04.276875 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 487/973] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:04 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:04.293046 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d386dc02-d9b5-4e97-90d0-a091ba75964d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:04.293597 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d386dc02-d9b5-4e97-90d0-a091ba75964d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:04.299887 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d386dc02-d9b5-4e97-90d0-a091ba75964d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:04.300346 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d386dc02-d9b5-4e97-90d0-a091ba75964d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:04.301128 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d386dc02-d9b5-4e97-90d0-a091ba75964d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:04.301562 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d386dc02-d9b5-4e97-90d0-a091ba75964d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:04.375144 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d386dc02-d9b5-4e97-90d0-a091ba75964d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [ee70b135-184d-431c-b408-6d03c6bfd860] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:26:05.382139 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [None req-d386dc02-d9b5-4e97-90d0-a091ba75964d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [ee70b135-184d-431c-b408-6d03c6bfd860] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 44660. May 10 03:26:05.385309 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d386dc02-d9b5-4e97-90d0-a091ba75964d tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "POST /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f/action" status: 202 len: 0 microversion: 2.1 time: 1.096689 May 10 03:26:05.385921 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 487/974] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 10 03:26:04 2022] POST /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f/action => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:26:05.394493 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-eafdb687-d89d-4f36-abdd-dfdfbd84159e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:05.395104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-eafdb687-d89d-4f36-abdd-dfdfbd84159e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:05.401858 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eafdb687-d89d-4f36-abdd-dfdfbd84159e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:05.402467 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eafdb687-d89d-4f36-abdd-dfdfbd84159e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:05.403212 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eafdb687-d89d-4f36-abdd-dfdfbd84159e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:05.403744 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-eafdb687-d89d-4f36-abdd-dfdfbd84159e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:05.576351 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-eafdb687-d89d-4f36-abdd-dfdfbd84159e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:05.584416 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-eafdb687-d89d-4f36-abdd-dfdfbd84159e tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1515 microversion: 2.1 time: 0.193699 May 10 03:26:05.585010 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 488/975] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:05 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:06.601928 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1f120f10-a68a-4b53-b7c7-3b58d386e9ea tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:06.602537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1f120f10-a68a-4b53-b7c7-3b58d386e9ea tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:06.609925 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1f120f10-a68a-4b53-b7c7-3b58d386e9ea tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:06.610378 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1f120f10-a68a-4b53-b7c7-3b58d386e9ea tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:06.611140 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1f120f10-a68a-4b53-b7c7-3b58d386e9ea tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:06.611563 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1f120f10-a68a-4b53-b7c7-3b58d386e9ea tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:06.742775 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1f120f10-a68a-4b53-b7c7-3b58d386e9ea tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:06.751105 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1f120f10-a68a-4b53-b7c7-3b58d386e9ea tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.153520 May 10 03:26:06.751665 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 488/976] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:06 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:06.850740 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-77d2b207-2a66-442b-aca1-64d943b04f89 req-0fc4b8aa-1cc2-48a5-9755-a664f195769d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ae322e-e02d-4c98-bd38-7d6721159d0f", "name": "network-vif-unplugged", "status": "completed", "tag": "e312bad7-40a5-425b-8e16-f9e8a2c718d1"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:06.858626 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-77d2b207-2a66-442b-aca1-64d943b04f89 req-0fc4b8aa-1cc2-48a5-9755-a664f195769d service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:06.859064 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-77d2b207-2a66-442b-aca1-64d943b04f89 req-0fc4b8aa-1cc2-48a5-9755-a664f195769d service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:06.870848 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-77d2b207-2a66-442b-aca1-64d943b04f89 req-0fc4b8aa-1cc2-48a5-9755-a664f195769d service nova] Creating event network-vif-unplugged:e312bad7-40a5-425b-8e16-f9e8a2c718d1 for instance 97ae322e-e02d-4c98-bd38-7d6721159d0f on hv-cinder-83009 May 10 03:26:06.875927 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-77d2b207-2a66-442b-aca1-64d943b04f89 req-0fc4b8aa-1cc2-48a5-9755-a664f195769d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090612 May 10 03:26:06.876514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 489/977] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:26:07.768592 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d243b879-e3c2-4b05-86ef-ba04ef001a11 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:07.769287 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d243b879-e3c2-4b05-86ef-ba04ef001a11 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:07.775852 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d243b879-e3c2-4b05-86ef-ba04ef001a11 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:07.776296 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d243b879-e3c2-4b05-86ef-ba04ef001a11 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:07.777643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d243b879-e3c2-4b05-86ef-ba04ef001a11 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:07.778065 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d243b879-e3c2-4b05-86ef-ba04ef001a11 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:07.909982 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d243b879-e3c2-4b05-86ef-ba04ef001a11 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:07.917894 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d243b879-e3c2-4b05-86ef-ba04ef001a11 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.152678 May 10 03:26:07.918459 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 489/978] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:07 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:08.936524 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-debf7b53-8695-47fa-9de2-ce5169860234 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:08.937260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-debf7b53-8695-47fa-9de2-ce5169860234 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:08.943461 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-debf7b53-8695-47fa-9de2-ce5169860234 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:08.943915 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-debf7b53-8695-47fa-9de2-ce5169860234 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:08.944708 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-debf7b53-8695-47fa-9de2-ce5169860234 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:08.945149 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-debf7b53-8695-47fa-9de2-ce5169860234 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:09.078308 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-debf7b53-8695-47fa-9de2-ce5169860234 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:09.085727 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-debf7b53-8695-47fa-9de2-ce5169860234 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.154987 May 10 03:26:09.086303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 490/979] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:08 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:10.103305 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-807130d9-0da6-47e8-a259-38878b09e036 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:10.104257 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-807130d9-0da6-47e8-a259-38878b09e036 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:10.110784 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-807130d9-0da6-47e8-a259-38878b09e036 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:10.111229 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-807130d9-0da6-47e8-a259-38878b09e036 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:10.111985 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-807130d9-0da6-47e8-a259-38878b09e036 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:10.112409 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-807130d9-0da6-47e8-a259-38878b09e036 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:10.241339 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-807130d9-0da6-47e8-a259-38878b09e036 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:10.249650 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-807130d9-0da6-47e8-a259-38878b09e036 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.150215 May 10 03:26:10.250219 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 490/980] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:10 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:11.268058 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-35a8382d-1312-4918-9971-c795c4792fed tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:11.270726 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-35a8382d-1312-4918-9971-c795c4792fed tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:11.275371 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-35a8382d-1312-4918-9971-c795c4792fed tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:11.275826 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-35a8382d-1312-4918-9971-c795c4792fed tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:11.277323 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-35a8382d-1312-4918-9971-c795c4792fed tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:11.277761 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-35a8382d-1312-4918-9971-c795c4792fed tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:11.405766 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-35a8382d-1312-4918-9971-c795c4792fed tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:11.413263 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-35a8382d-1312-4918-9971-c795c4792fed tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.149238 May 10 03:26:11.413824 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 491/981] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:11 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:12.430315 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-ab6df5aa-d201-4687-b730-173173f1e1e8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:12.430927 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-ab6df5aa-d201-4687-b730-173173f1e1e8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:12.437322 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ab6df5aa-d201-4687-b730-173173f1e1e8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:12.437924 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ab6df5aa-d201-4687-b730-173173f1e1e8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:12.438689 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ab6df5aa-d201-4687-b730-173173f1e1e8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:12.439121 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-ab6df5aa-d201-4687-b730-173173f1e1e8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:12.569247 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-ab6df5aa-d201-4687-b730-173173f1e1e8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:12.577138 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-ab6df5aa-d201-4687-b730-173173f1e1e8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.150788 May 10 03:26:12.577702 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 491/982] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:12 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:13.076782 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed May 10 03:26:13.594535 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-27dd892b-0f67-42e1-80a5-2e4d80deb02f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:13.595145 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-27dd892b-0f67-42e1-80a5-2e4d80deb02f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:13.601476 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-27dd892b-0f67-42e1-80a5-2e4d80deb02f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:13.601919 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-27dd892b-0f67-42e1-80a5-2e4d80deb02f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:13.602678 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-27dd892b-0f67-42e1-80a5-2e4d80deb02f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:13.603105 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-27dd892b-0f67-42e1-80a5-2e4d80deb02f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:13.727119 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-27dd892b-0f67-42e1-80a5-2e4d80deb02f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:13.735202 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-27dd892b-0f67-42e1-80a5-2e4d80deb02f tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.144567 May 10 03:26:13.735772 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 492/983] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:13 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:26:14.753143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4063e679-0252-4ac3-aeb6-df1612824ab8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:14.753786 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-4063e679-0252-4ac3-aeb6-df1612824ab8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:14.760043 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4063e679-0252-4ac3-aeb6-df1612824ab8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:14.760976 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4063e679-0252-4ac3-aeb6-df1612824ab8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:14.761707 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4063e679-0252-4ac3-aeb6-df1612824ab8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:14.761893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-4063e679-0252-4ac3-aeb6-df1612824ab8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:14.892529 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-4063e679-0252-4ac3-aeb6-df1612824ab8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:14.900290 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4063e679-0252-4ac3-aeb6-df1612824ab8 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.151261 May 10 03:26:14.900890 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 492/984] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:14 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:15.917578 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-bdad2572-c807-4882-9530-959779331908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:15.918131 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-bdad2572-c807-4882-9530-959779331908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:15.924445 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bdad2572-c807-4882-9530-959779331908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:15.924930 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bdad2572-c807-4882-9530-959779331908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:15.925699 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bdad2572-c807-4882-9530-959779331908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:15.926132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-bdad2572-c807-4882-9530-959779331908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:16.055750 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-bdad2572-c807-4882-9530-959779331908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:16.063793 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-bdad2572-c807-4882-9530-959779331908 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.150247 May 10 03:26:16.064365 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 493/985] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:15 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:16.864106 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-8313f4d7-c15c-44d0-ac7d-be74c1ded341 req-49f8f65d-e78f-43c3-a249-71f92475b0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ae322e-e02d-4c98-bd38-7d6721159d0f", "name": "network-vif-plugged", "status": "completed", "tag": "e312bad7-40a5-425b-8e16-f9e8a2c718d1"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:16.872998 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-8313f4d7-c15c-44d0-ac7d-be74c1ded341 req-49f8f65d-e78f-43c3-a249-71f92475b0f6 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:16.873456 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-8313f4d7-c15c-44d0-ac7d-be74c1ded341 req-49f8f65d-e78f-43c3-a249-71f92475b0f6 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:16.884150 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-8313f4d7-c15c-44d0-ac7d-be74c1ded341 req-49f8f65d-e78f-43c3-a249-71f92475b0f6 service nova] Creating event network-vif-plugged:e312bad7-40a5-425b-8e16-f9e8a2c718d1 for instance 97ae322e-e02d-4c98-bd38-7d6721159d0f on hv-cinder-83009 May 10 03:26:16.889323 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-8313f4d7-c15c-44d0-ac7d-be74c1ded341 req-49f8f65d-e78f-43c3-a249-71f92475b0f6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028830 May 10 03:26:16.890104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 493/986] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:26:17.080695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-68e8ba51-ac92-41b9-92a5-904150fded84 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:17.081303 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-68e8ba51-ac92-41b9-92a5-904150fded84 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:17.087828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-68e8ba51-ac92-41b9-92a5-904150fded84 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:17.088273 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-68e8ba51-ac92-41b9-92a5-904150fded84 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:17.089720 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-68e8ba51-ac92-41b9-92a5-904150fded84 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:17.090169 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-68e8ba51-ac92-41b9-92a5-904150fded84 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:17.217515 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-68e8ba51-ac92-41b9-92a5-904150fded84 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:17.224862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-68e8ba51-ac92-41b9-92a5-904150fded84 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1573 microversion: 2.1 time: 0.148153 May 10 03:26:17.225424 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 494/987] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:17 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:18.242550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-28c5bbea-919d-4547-ae5a-2f1d3033f671 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:18.243217 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-28c5bbea-919d-4547-ae5a-2f1d3033f671 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:18.250145 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28c5bbea-919d-4547-ae5a-2f1d3033f671 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:18.250588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28c5bbea-919d-4547-ae5a-2f1d3033f671 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:18.251354 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28c5bbea-919d-4547-ae5a-2f1d3033f671 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:18.251787 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-28c5bbea-919d-4547-ae5a-2f1d3033f671 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:18.397017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-28c5bbea-919d-4547-ae5a-2f1d3033f671 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:18.405211 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-28c5bbea-919d-4547-ae5a-2f1d3033f671 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1560 microversion: 2.1 time: 0.167424 May 10 03:26:18.405822 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 494/988] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:26:18 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:04.455514 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:27:04.456048 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Tue May 10 03:27:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:27:31.875852 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-4d91338b-d035-4d83-9dac-1323639f9ba3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:31.876497 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4d91338b-d035-4d83-9dac-1323639f9ba3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:31.883808 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d91338b-d035-4d83-9dac-1323639f9ba3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:31.884270 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d91338b-d035-4d83-9dac-1323639f9ba3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:31.885088 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d91338b-d035-4d83-9dac-1323639f9ba3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:31.885528 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-4d91338b-d035-4d83-9dac-1323639f9ba3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:31.913636 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-4d91338b-d035-4d83-9dac-1323639f9ba3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:27:31.975299 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-9619ec71-44fa-41a1-a8e4-cf00e3582ff4 req-734a2cee-a377-4cdb-a896-4c8c9c5529fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ae322e-e02d-4c98-bd38-7d6721159d0f", "tag": "e312bad7-40a5-425b-8e16-f9e8a2c718d1"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:31.986247 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-9619ec71-44fa-41a1-a8e4-cf00e3582ff4 req-734a2cee-a377-4cdb-a896-4c8c9c5529fb service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:31.986783 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-9619ec71-44fa-41a1-a8e4-cf00e3582ff4 req-734a2cee-a377-4cdb-a896-4c8c9c5529fb service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:32.001781 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-4d91338b-d035-4d83-9dac-1323639f9ba3 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 204 len: 0 microversion: 2.1 time: 0.131467 May 10 03:27:32.002571 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 495/989] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:27:31 2022] DELETE /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:27:32.011208 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e69a5d9f-fe71-4b20-9e46-7fddc85923bf tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:32.011928 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e69a5d9f-fe71-4b20-9e46-7fddc85923bf tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:32.014632 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-9619ec71-44fa-41a1-a8e4-cf00e3582ff4 req-734a2cee-a377-4cdb-a896-4c8c9c5529fb service nova] Creating event network-changed:e312bad7-40a5-425b-8e16-f9e8a2c718d1 for instance 97ae322e-e02d-4c98-bd38-7d6721159d0f on hv-cinder-83009 May 10 03:27:32.017942 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e69a5d9f-fe71-4b20-9e46-7fddc85923bf tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:32.018464 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e69a5d9f-fe71-4b20-9e46-7fddc85923bf tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:32.019230 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e69a5d9f-fe71-4b20-9e46-7fddc85923bf tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:32.019659 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e69a5d9f-fe71-4b20-9e46-7fddc85923bf tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:32.021090 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-9619ec71-44fa-41a1-a8e4-cf00e3582ff4 req-734a2cee-a377-4cdb-a896-4c8c9c5529fb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148855 May 10 03:27:32.021680 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 495/990] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:27:32.155042 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e69a5d9f-fe71-4b20-9e46-7fddc85923bf tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:32.163054 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e69a5d9f-fe71-4b20-9e46-7fddc85923bf tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.156011 May 10 03:27:32.163630 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 496/991] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:27:32 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:33.235658 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-aa3ac90b-2c17-459c-ae4f-678067586d3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:33.236402 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-aa3ac90b-2c17-459c-ae4f-678067586d3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:33.242700 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aa3ac90b-2c17-459c-ae4f-678067586d3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:33.243150 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aa3ac90b-2c17-459c-ae4f-678067586d3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:33.243928 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aa3ac90b-2c17-459c-ae4f-678067586d3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:33.244364 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aa3ac90b-2c17-459c-ae4f-678067586d3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:33.379323 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-aa3ac90b-2c17-459c-ae4f-678067586d3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:33.386674 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-aa3ac90b-2c17-459c-ae4f-678067586d3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1566 microversion: 2.1 time: 0.155918 May 10 03:27:33.387781 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 496/992] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:27:33 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:34.035423 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-d817988b-ca16-4e35-a45a-05cdeff31599 req-ee36da5a-e230-4a8a-8f07-53b1b40e8b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ae322e-e02d-4c98-bd38-7d6721159d0f", "name": "network-vif-deleted", "tag": "e312bad7-40a5-425b-8e16-f9e8a2c718d1"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:34.044507 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-d817988b-ca16-4e35-a45a-05cdeff31599 req-ee36da5a-e230-4a8a-8f07-53b1b40e8b98 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:34.045075 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-d817988b-ca16-4e35-a45a-05cdeff31599 req-ee36da5a-e230-4a8a-8f07-53b1b40e8b98 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:34.055738 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-d817988b-ca16-4e35-a45a-05cdeff31599 req-ee36da5a-e230-4a8a-8f07-53b1b40e8b98 service nova] Creating event network-vif-deleted:e312bad7-40a5-425b-8e16-f9e8a2c718d1 for instance 97ae322e-e02d-4c98-bd38-7d6721159d0f on hv-cinder-83009 May 10 03:27:34.062001 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-d817988b-ca16-4e35-a45a-05cdeff31599 req-ee36da5a-e230-4a8a-8f07-53b1b40e8b98 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030423 May 10 03:27:34.063158 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 497/993] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:34.403722 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:34.404371 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:34.411035 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:34.411489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:34.412261 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:34.412728 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:34.443748 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:34.444260 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:34.444747 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lazy-loading 'fault' on Instance uuid 97ae322e-e02d-4c98-bd38-7d6721159d0f {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:27:34.485580 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a2a1e98e494e3992f0524efb235da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27c98ff77b04578b98906b2f6e6b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:34.493128 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-da5f8e2e-6c5b-4247-8fba-a6cf35044bb5 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 200 len: 1222 microversion: 2.1 time: 0.093269 May 10 03:27:34.493727 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 497/994] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:27:34 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:35.512960 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:35.513840 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] [instance: 97ae322e-e02d-4c98-bd38-7d6721159d0f] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:35.520064 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:35.520524 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:35.521400 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:35.521919 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:35.536385 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] HTTP exception thrown: Instance 97ae322e-e02d-4c98-bd38-7d6721159d0f could not be found. May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Request method failure captured: May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f HTTP/1.1 May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABiedqoO_nGf9G1wkuIXrIFzxa9GTHclbnzCJZIsyqGnmPRdKCQ1P3vQo3OYFYrPv_R7AD8sq9sIsalnEJdJcxu7oty_EPNLprJu4t0n9S0dAC5JzuZFFRHlcBWtnWxWtamQEYtGvsumJCwTrT03VixEVSLRh6YBDYlGXRVxpzKVkckb4Q May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: d27c98ff77b04578b98906b2f6e6b449 May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-TestShelveInstance-1303379275 May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:27:35.538056 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d27c98ff77b04578b98906b2f6e6b449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d27c98ff77b04578b98906b2f6e6b449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d27c98ff77b04578b98906b2f6e6b449", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d27c98ff77b04578b98906b2f6e6b449"}]}] May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-TestShelveInstance-1303379275 May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: d27c98ff77b04578b98906b2f6e6b449 May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-TestShelveInstance-1303379275 May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-TestShelveInstance-1303379275-project May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: b0a2a1e98e494e3992f0524efb235da3 May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-TestShelveInstance-1303379275-project May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 97ae322e-e02d-4c98-bd38-7d6721159d0f could not be found. May 10 03:27:35.539787 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '97ae322e-e02d-4c98-bd38-7d6721159d0f'} May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ae322e-e02d-4c98-bd38-7d6721159d0f could not be found. May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:27:35.540778 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ae322e-e02d-4c98-bd38-7d6721159d0f could not be found. May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ae322e-e02d-4c98-bd38-7d6721159d0f could not be found. May 10 03:27:35.542345 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:27:35.543826 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Returning 404 to user: Instance 97ae322e-e02d-4c98-bd38-7d6721159d0f could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:27:35.543826 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5497f589-a900-48c8-af3f-3d61f4c4fb77 tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f" status: 404 len: 111 microversion: 2.1 time: 0.031765 May 10 03:27:35.543826 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 498/995] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:27:35 2022] GET /compute/v2.1/servers/97ae322e-e02d-4c98-bd38-7d6721159d0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:27:35.694304 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d1c020db-26ca-4273-9103-99e59cc74e3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] Calling method '.version_select at 0x7f14a44f5af0>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:35.719973 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d1c020db-26ca-4273-9103-99e59cc74e3c tempest-TestShelveInstance-1303379275 tempest-TestShelveInstance-1303379275-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-67125290" status: 202 len: 0 microversion: 2.1 time: 0.029475 May 10 03:27:35.720556 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 498/996] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 10 03:27:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-67125290 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:27:52.567924 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-82b51209-eb98-4374-9af4-bfa26cb258f9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Action: 'create', calling method: .version_select at 0x7f1497df0ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1710297732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN60kyg3WHoLOIQ9lCWjmwTnlzvO45/lKq7oqXp8nk56uhNiRl0dvVWaXoiRhYznXQKGCKTo3pp312sjmUfSYtxwKsnqCkq8XkgTj5bBO83qDhXEWpXncNPS1NhSUyoCw=="}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:52.612457 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-82b51209-eb98-4374-9af4-bfa26cb258f9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Getting quotas for project d31c39583b8343bd98bdc64d7659bd9a. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:27:52.616374 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.quota [None req-82b51209-eb98-4374-9af4-bfa26cb258f9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Getting quotas for user 4907ee21ee894003a8a237c99302ed88 and project d31c39583b8343bd98bdc64d7659bd9a. Resources: {'key_pairs'} {{(pid=117120) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:27:52.628052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82b51209-eb98-4374-9af4-bfa26cb258f9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [6645d305-ceda-4315-9ba3-e7cc3fe49206] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:27:53.635871 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [None req-82b51209-eb98-4374-9af4-bfa26cb258f9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [6645d305-ceda-4315-9ba3-e7cc3fe49206] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 44848. May 10 03:27:53.649377 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-82b51209-eb98-4374-9af4-bfa26cb258f9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.266760 May 10 03:27:53.649975 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 499/997] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 10 03:27:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:28:09.036542 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1880330796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1710297732", "security_groups": [{"name": "tempest-secgroup-smoke-41511010"}], "block_device_mapping_v2": [{"uuid": "7e9a189f-10d5-46b6-932e-3c7040147d80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb3e2c1e-39b9-4b58-b94c-d8644c9c7ee2"}]}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:28:09.145188 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] validate_networks() for [('cb3e2c1e-39b9-4b58-b94c-d8644c9c7ee2', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:28:09.594346 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:28:09.594771 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:28:09.595310 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:28:09.595716 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:28:09.596124 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:28:09.604741 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:09.605200 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:09.606004 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:09.606436 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:09.622355 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Getting quotas for project d31c39583b8343bd98bdc64d7659bd9a. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:28:09.626395 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Getting quotas for user 4907ee21ee894003a8a237c99302ed88 and project d31c39583b8343bd98bdc64d7659bd9a. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:28:09.681793 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:28:09.683905 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e9a189f-10d5-46b6-932e-3c7040147d80',volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:28:09.806599 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-11ce8253-495e-400b-90dc-869398bfcf97 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.774265 May 10 03:28:09.807258 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 499/998] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:28:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:28:09.817897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7d465c2b-6a05-40e8-9d4d-e27c381e1c77 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:09.818513 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7d465c2b-6a05-40e8-9d4d-e27c381e1c77 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:09.873367 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-7d465c2b-6a05-40e8-9d4d-e27c381e1c77 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:09.879923 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7d465c2b-6a05-40e8-9d4d-e27c381e1c77 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1095 microversion: 2.1 time: 0.066457 May 10 03:28:09.880681 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 500/999] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:09 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:10.897790 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-403d7a59-d963-48d0-ba1e-b70bce08f6f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:10.898410 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-403d7a59-d963-48d0-ba1e-b70bce08f6f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:10.905482 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-403d7a59-d963-48d0-ba1e-b70bce08f6f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:10.905918 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-403d7a59-d963-48d0-ba1e-b70bce08f6f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:10.906683 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-403d7a59-d963-48d0-ba1e-b70bce08f6f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:10.907122 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-403d7a59-d963-48d0-ba1e-b70bce08f6f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:10.974397 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-403d7a59-d963-48d0-ba1e-b70bce08f6f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:10.982732 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-403d7a59-d963-48d0-ba1e-b70bce08f6f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1211 microversion: 2.1 time: 0.089047 May 10 03:28:10.983243 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 500/1000] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:10 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:12.000442 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a4d04f9c-0aca-4123-8f55-ec6fd29505fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:12.001165 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-a4d04f9c-0aca-4123-8f55-ec6fd29505fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:12.008154 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a4d04f9c-0aca-4123-8f55-ec6fd29505fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:12.008552 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-4a1fbec5-bd80-48f1-9484-79bd06f9afea req-d16e160d-fc45-46e1-8ab7-ba580991d2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f843def1-c182-4652-bac3-37e5d494cb3e", "tag": "f3d79a52-8746-4f7f-b99f-60c6788062cb"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:28:12.009477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a4d04f9c-0aca-4123-8f55-ec6fd29505fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:12.010507 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a4d04f9c-0aca-4123-8f55-ec6fd29505fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:12.020850 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-4a1fbec5-bd80-48f1-9484-79bd06f9afea req-d16e160d-fc45-46e1-8ab7-ba580991d2a8 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:12.021640 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-4a1fbec5-bd80-48f1-9484-79bd06f9afea req-d16e160d-fc45-46e1-8ab7-ba580991d2a8 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:12.022017 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-a4d04f9c-0aca-4123-8f55-ec6fd29505fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:12.038817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-4a1fbec5-bd80-48f1-9484-79bd06f9afea req-d16e160d-fc45-46e1-8ab7-ba580991d2a8 service nova] Creating event network-changed:f3d79a52-8746-4f7f-b99f-60c6788062cb for instance f843def1-c182-4652-bac3-37e5d494cb3e on hv-cinder-83009 May 10 03:28:12.052691 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-4a1fbec5-bd80-48f1-9484-79bd06f9afea req-d16e160d-fc45-46e1-8ab7-ba580991d2a8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059110 May 10 03:28:12.053468 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 501/1001] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:28:12.167352 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-a4d04f9c-0aca-4123-8f55-ec6fd29505fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:12.180321 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a4d04f9c-0aca-4123-8f55-ec6fd29505fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.184516 May 10 03:28:12.181218 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 501/1002] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:11 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:13.200354 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-ef3e13fc-a216-47cd-b3b4-4ac4e82b6e9e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:13.201077 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-ef3e13fc-a216-47cd-b3b4-4ac4e82b6e9e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:13.207155 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef3e13fc-a216-47cd-b3b4-4ac4e82b6e9e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:13.207600 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef3e13fc-a216-47cd-b3b4-4ac4e82b6e9e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:13.208356 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef3e13fc-a216-47cd-b3b4-4ac4e82b6e9e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:13.208887 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-ef3e13fc-a216-47cd-b3b4-4ac4e82b6e9e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:13.342704 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-ef3e13fc-a216-47cd-b3b4-4ac4e82b6e9e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:13.349937 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-ef3e13fc-a216-47cd-b3b4-4ac4e82b6e9e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.155260 May 10 03:28:13.350494 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 502/1003] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:13 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:14.367352 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-36440055-34c2-471a-8ace-b01cff5a3c5a tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:14.367875 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-36440055-34c2-471a-8ace-b01cff5a3c5a tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:14.374424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-36440055-34c2-471a-8ace-b01cff5a3c5a tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:14.374876 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-36440055-34c2-471a-8ace-b01cff5a3c5a tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:14.375640 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-36440055-34c2-471a-8ace-b01cff5a3c5a tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:14.376076 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-36440055-34c2-471a-8ace-b01cff5a3c5a tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:14.507405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-36440055-34c2-471a-8ace-b01cff5a3c5a tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:14.515250 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-36440055-34c2-471a-8ace-b01cff5a3c5a tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.151847 May 10 03:28:14.515817 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 502/1004] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:14 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:15.532429 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0031b80a-76c1-4efa-af5a-c399427afd56 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:15.533080 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0031b80a-76c1-4efa-af5a-c399427afd56 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:15.539651 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0031b80a-76c1-4efa-af5a-c399427afd56 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:15.540097 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0031b80a-76c1-4efa-af5a-c399427afd56 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:15.540891 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0031b80a-76c1-4efa-af5a-c399427afd56 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:15.541326 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-0031b80a-76c1-4efa-af5a-c399427afd56 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:15.671774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0031b80a-76c1-4efa-af5a-c399427afd56 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:15.679162 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0031b80a-76c1-4efa-af5a-c399427afd56 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.150570 May 10 03:28:15.679725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 503/1005] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:15 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:16.696136 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3b919981-b592-4792-a111-8cb11f6cc65d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:16.696793 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-3b919981-b592-4792-a111-8cb11f6cc65d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:16.703083 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3b919981-b592-4792-a111-8cb11f6cc65d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:16.703527 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3b919981-b592-4792-a111-8cb11f6cc65d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:16.704286 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3b919981-b592-4792-a111-8cb11f6cc65d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:16.704749 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-3b919981-b592-4792-a111-8cb11f6cc65d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:16.830795 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-3b919981-b592-4792-a111-8cb11f6cc65d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:16.838048 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3b919981-b592-4792-a111-8cb11f6cc65d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.145809 May 10 03:28:16.838624 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 503/1006] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:16 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:17.855791 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b03946d3-0608-48e2-bb5f-f0239e0d2397 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:17.856535 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b03946d3-0608-48e2-bb5f-f0239e0d2397 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:17.862970 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b03946d3-0608-48e2-bb5f-f0239e0d2397 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:17.863452 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b03946d3-0608-48e2-bb5f-f0239e0d2397 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:17.864217 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b03946d3-0608-48e2-bb5f-f0239e0d2397 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:17.864666 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b03946d3-0608-48e2-bb5f-f0239e0d2397 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:17.990998 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b03946d3-0608-48e2-bb5f-f0239e0d2397 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:17.998491 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b03946d3-0608-48e2-bb5f-f0239e0d2397 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.147125 May 10 03:28:17.999066 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 504/1007] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:17 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:19.015424 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cbf36b5b-c9cc-41d9-8b65-0e365fe839c8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:19.016029 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-cbf36b5b-c9cc-41d9-8b65-0e365fe839c8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:19.022391 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cbf36b5b-c9cc-41d9-8b65-0e365fe839c8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:19.022839 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cbf36b5b-c9cc-41d9-8b65-0e365fe839c8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:19.023607 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cbf36b5b-c9cc-41d9-8b65-0e365fe839c8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:19.024042 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-cbf36b5b-c9cc-41d9-8b65-0e365fe839c8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:19.156033 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-cbf36b5b-c9cc-41d9-8b65-0e365fe839c8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:19.163604 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-cbf36b5b-c9cc-41d9-8b65-0e365fe839c8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.152350 May 10 03:28:19.164169 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 504/1008] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:19 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:20.180704 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-014e0dc3-ef9b-4469-ade8-1e77fbed4377 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:20.181272 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-014e0dc3-ef9b-4469-ade8-1e77fbed4377 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:20.187638 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-014e0dc3-ef9b-4469-ade8-1e77fbed4377 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:20.188085 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-014e0dc3-ef9b-4469-ade8-1e77fbed4377 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:20.188876 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-014e0dc3-ef9b-4469-ade8-1e77fbed4377 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:20.189308 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-014e0dc3-ef9b-4469-ade8-1e77fbed4377 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:20.320439 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-014e0dc3-ef9b-4469-ade8-1e77fbed4377 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:20.328242 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-014e0dc3-ef9b-4469-ade8-1e77fbed4377 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.151566 May 10 03:28:20.328827 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 505/1009] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:20 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:21.346124 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8eaa1596-fb39-4fa3-9ee3-5c0899ef60da tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:21.346663 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8eaa1596-fb39-4fa3-9ee3-5c0899ef60da tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:21.352936 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8eaa1596-fb39-4fa3-9ee3-5c0899ef60da tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:21.353404 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8eaa1596-fb39-4fa3-9ee3-5c0899ef60da tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:21.354197 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8eaa1596-fb39-4fa3-9ee3-5c0899ef60da tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:21.354809 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8eaa1596-fb39-4fa3-9ee3-5c0899ef60da tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:21.488326 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8eaa1596-fb39-4fa3-9ee3-5c0899ef60da tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:21.497172 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8eaa1596-fb39-4fa3-9ee3-5c0899ef60da tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.154264 May 10 03:28:21.498007 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 505/1010] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:21 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:22.513892 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-42925ef8-39df-47dc-8068-a91ab7db26af tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:22.514497 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-42925ef8-39df-47dc-8068-a91ab7db26af tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:22.521039 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42925ef8-39df-47dc-8068-a91ab7db26af tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:22.521486 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42925ef8-39df-47dc-8068-a91ab7db26af tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:22.522250 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42925ef8-39df-47dc-8068-a91ab7db26af tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:22.522681 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-42925ef8-39df-47dc-8068-a91ab7db26af tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:22.651615 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-42925ef8-39df-47dc-8068-a91ab7db26af tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:22.659158 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-42925ef8-39df-47dc-8068-a91ab7db26af tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.149240 May 10 03:28:22.659753 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 506/1011] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:22 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:23.470693 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-d5f9fb15-5c57-4e95-9d81-54177e99d533 req-b471a352-aae6-477c-a6cb-c4a2f34d893c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f843def1-c182-4652-bac3-37e5d494cb3e", "name": "network-vif-plugged", "status": "completed", "tag": "f3d79a52-8746-4f7f-b99f-60c6788062cb"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:28:23.479385 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-d5f9fb15-5c57-4e95-9d81-54177e99d533 req-b471a352-aae6-477c-a6cb-c4a2f34d893c service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:23.479870 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-d5f9fb15-5c57-4e95-9d81-54177e99d533 req-b471a352-aae6-477c-a6cb-c4a2f34d893c service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:23.491654 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-d5f9fb15-5c57-4e95-9d81-54177e99d533 req-b471a352-aae6-477c-a6cb-c4a2f34d893c service nova] Creating event network-vif-plugged:f3d79a52-8746-4f7f-b99f-60c6788062cb for instance f843def1-c182-4652-bac3-37e5d494cb3e on hv-cinder-83009 May 10 03:28:23.497166 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-d5f9fb15-5c57-4e95-9d81-54177e99d533 req-b471a352-aae6-477c-a6cb-c4a2f34d893c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030065 May 10 03:28:23.497912 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 506/1012] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:28:23.677417 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a1cf8d9f-37dd-4147-931c-473dd8c7723f tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:23.678013 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-a1cf8d9f-37dd-4147-931c-473dd8c7723f tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:23.684676 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a1cf8d9f-37dd-4147-931c-473dd8c7723f tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:23.685220 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a1cf8d9f-37dd-4147-931c-473dd8c7723f tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:23.686052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a1cf8d9f-37dd-4147-931c-473dd8c7723f tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:23.686553 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-a1cf8d9f-37dd-4147-931c-473dd8c7723f tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:23.836450 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-a1cf8d9f-37dd-4147-931c-473dd8c7723f tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:23.844545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a1cf8d9f-37dd-4147-931c-473dd8c7723f tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1265 microversion: 2.1 time: 0.171184 May 10 03:28:23.845136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 507/1013] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:23 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:24.862218 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f290f959-92b7-4e43-b83a-d956632d73a9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:24.862825 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f290f959-92b7-4e43-b83a-d956632d73a9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:24.869145 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f290f959-92b7-4e43-b83a-d956632d73a9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:24.869591 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f290f959-92b7-4e43-b83a-d956632d73a9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:24.870347 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f290f959-92b7-4e43-b83a-d956632d73a9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:24.870778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f290f959-92b7-4e43-b83a-d956632d73a9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:24.999177 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f290f959-92b7-4e43-b83a-d956632d73a9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:25.006651 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f290f959-92b7-4e43-b83a-d956632d73a9 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1452 microversion: 2.1 time: 0.148521 May 10 03:28:25.007435 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 507/1014] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:24 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:28:25.023033 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7c683d6e-8fc1-49e7-93af-869089cdf5e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:25.023750 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7c683d6e-8fc1-49e7-93af-869089cdf5e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:25.030994 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7c683d6e-8fc1-49e7-93af-869089cdf5e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:25.031441 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7c683d6e-8fc1-49e7-93af-869089cdf5e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:25.032213 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7c683d6e-8fc1-49e7-93af-869089cdf5e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:25.032644 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7c683d6e-8fc1-49e7-93af-869089cdf5e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:25.158549 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-7c683d6e-8fc1-49e7-93af-869089cdf5e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:25.166326 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7c683d6e-8fc1-49e7-93af-869089cdf5e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1452 microversion: 2.1 time: 0.147463 May 10 03:28:25.166898 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 508/1015] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:28:25 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:26.788994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-c22df077-8b92-4f4a-9b53-b4b06081f1ea req-9f284b70-ce7e-440e-ba30-7e2b0a929b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f843def1-c182-4652-bac3-37e5d494cb3e", "tag": "f3d79a52-8746-4f7f-b99f-60c6788062cb"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:28:26.797537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-c22df077-8b92-4f4a-9b53-b4b06081f1ea req-9f284b70-ce7e-440e-ba30-7e2b0a929b00 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:26.797986 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-c22df077-8b92-4f4a-9b53-b4b06081f1ea req-9f284b70-ce7e-440e-ba30-7e2b0a929b00 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:26.810748 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-c22df077-8b92-4f4a-9b53-b4b06081f1ea req-9f284b70-ce7e-440e-ba30-7e2b0a929b00 service nova] Creating event network-changed:f3d79a52-8746-4f7f-b99f-60c6788062cb for instance f843def1-c182-4652-bac3-37e5d494cb3e on hv-cinder-83009 May 10 03:28:26.816096 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-c22df077-8b92-4f4a-9b53-b4b06081f1ea req-9f284b70-ce7e-440e-ba30-7e2b0a929b00 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032346 May 10 03:28:26.817157 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 508/1016] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:30:22.002567 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6bbf5464-76a4-4d4b-a380-8e24d3c3ced2] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 03:30:22.006370 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9aaf488f-9aa4-4082-8fe7-86b8711b4450 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:22.006862 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9aaf488f-9aa4-4082-8fe7-86b8711b4450 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:22.014194 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9aaf488f-9aa4-4082-8fe7-86b8711b4450 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:22.014390 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9aaf488f-9aa4-4082-8fe7-86b8711b4450 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:22.015094 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9aaf488f-9aa4-4082-8fe7-86b8711b4450 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:22.015593 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9aaf488f-9aa4-4082-8fe7-86b8711b4450 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:22.041637 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9aaf488f-9aa4-4082-8fe7-86b8711b4450 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Going to try to terminate instance {{(pid=117120) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:30:22.118984 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9aaf488f-9aa4-4082-8fe7-86b8711b4450 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 204 len: 0 microversion: 2.1 time: 0.118551 May 10 03:30:22.119793 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 509/1017] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:30:21 2022] DELETE /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:30:22.126832 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6498c61f-46b4-40de-926e-55958668e2c9] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:30:22.131323 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e4d0b312-adc4-48b4-9577-2c2940e6d0eb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:22.132024 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e4d0b312-adc4-48b4-9577-2c2940e6d0eb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:22.138235 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e4d0b312-adc4-48b4-9577-2c2940e6d0eb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:22.138686 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e4d0b312-adc4-48b4-9577-2c2940e6d0eb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:22.139457 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e4d0b312-adc4-48b4-9577-2c2940e6d0eb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:22.139891 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e4d0b312-adc4-48b4-9577-2c2940e6d0eb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:22.277088 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e4d0b312-adc4-48b4-9577-2c2940e6d0eb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:22.285149 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e4d0b312-adc4-48b4-9577-2c2940e6d0eb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1577 microversion: 2.1 time: 0.160996 May 10 03:30:22.285713 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 509/1018] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:22 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:23.303177 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7197994b-9278-4385-a650-e1e5b627aa8c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:23.303883 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-7197994b-9278-4385-a650-e1e5b627aa8c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:23.311314 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7197994b-9278-4385-a650-e1e5b627aa8c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:23.311817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7197994b-9278-4385-a650-e1e5b627aa8c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:23.313260 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7197994b-9278-4385-a650-e1e5b627aa8c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:23.313785 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-7197994b-9278-4385-a650-e1e5b627aa8c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:23.330954 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] [6bbf5464-76a4-4d4b-a380-8e24d3c3ced2] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 45070. May 10 03:30:23.480627 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-7197994b-9278-4385-a650-e1e5b627aa8c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:23.488062 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7197994b-9278-4385-a650-e1e5b627aa8c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1577 microversion: 2.1 time: 0.189167 May 10 03:30:23.488633 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 510/1019] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:23 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:24.510857 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5e8717bc-4cc1-40f4-99c3-f1a062edd788 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:24.511846 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-eae581a7-c85d-4293-81fd-2829e934b92d req-4c86a377-4176-40d5-b98d-44295ed60012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f843def1-c182-4652-bac3-37e5d494cb3e", "name": "network-vif-deleted", "tag": "f3d79a52-8746-4f7f-b99f-60c6788062cb"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:30:24.515373 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5e8717bc-4cc1-40f4-99c3-f1a062edd788 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:24.522699 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5e8717bc-4cc1-40f4-99c3-f1a062edd788 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:24.531049 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-eae581a7-c85d-4293-81fd-2829e934b92d req-4c86a377-4176-40d5-b98d-44295ed60012 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:24.531696 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-eae581a7-c85d-4293-81fd-2829e934b92d req-4c86a377-4176-40d5-b98d-44295ed60012 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:24.536051 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5e8717bc-4cc1-40f4-99c3-f1a062edd788 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:24.537550 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5e8717bc-4cc1-40f4-99c3-f1a062edd788 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:24.538018 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5e8717bc-4cc1-40f4-99c3-f1a062edd788 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:24.563471 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-eae581a7-c85d-4293-81fd-2829e934b92d req-4c86a377-4176-40d5-b98d-44295ed60012 service nova] Creating event network-vif-deleted:f3d79a52-8746-4f7f-b99f-60c6788062cb for instance f843def1-c182-4652-bac3-37e5d494cb3e on hv-cinder-83009 May 10 03:30:24.573823 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-eae581a7-c85d-4293-81fd-2829e934b92d req-4c86a377-4176-40d5-b98d-44295ed60012 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067288 May 10 03:30:24.575045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 511/1020] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:30:24.585863 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [-] [6498c61f-46b4-40de-926e-55958668e2c9] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 45076. May 10 03:30:24.633960 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-5e8717bc-4cc1-40f4-99c3-f1a062edd788 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:24.641699 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5e8717bc-4cc1-40f4-99c3-f1a062edd788 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 200 len: 1226 microversion: 2.1 time: 0.139871 May 10 03:30:24.642279 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 510/1021] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:24 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 1226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:25.659873 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:25.660553 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:25.667080 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:25.667532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:25.668300 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:25.668759 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:25.681806 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] HTTP exception thrown: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Request method failure captured: May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e HTTP/1.1 May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABieduz-Xd8ueY2TLU1VtmyFlt6hHe9mb_ARmIA24hWk-SoP4Y-kiHb0_NHXNKDwJLPDmXwToJQBGHaL6L4ypuT341VxQMSyuHUTfw8MTsnUyWuKj0Ic8Oj3RRM25BBxQjHq9CFrTsscAsm6_Rz3DorjxzRTfIVITSy_MQmWm3i_3WVowo May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:30:25.683444 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d31c39583b8343bd98bdc64d7659bd9a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d31c39583b8343bd98bdc64d7659bd9a"}]}] May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-TestVolumeBootPattern-271887619 May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-TestVolumeBootPattern-271887619-project May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 4907ee21ee894003a8a237c99302ed88 May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-TestVolumeBootPattern-271887619-project May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:30:25.685052 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': 'f843def1-c182-4652-bac3-37e5d494cb3e'} May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:30:25.685889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:30:25.688007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:30:25.689454 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Returning 404 to user: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:30:25.689454 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6a23b4d5-d11f-415c-9b19-4935688978d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 404 len: 111 microversion: 2.1 time: 0.029887 May 10 03:30:25.689454 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 512/1022] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:25 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:30:25.732128 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-809382884", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1710297732", "security_groups": [{"name": "tempest-secgroup-smoke-41511010"}], "block_device_mapping_v2": [{"uuid": "7e9a189f-10d5-46b6-932e-3c7040147d80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb3e2c1e-39b9-4b58-b94c-d8644c9c7ee2"}]}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:30:25.839849 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] validate_networks() for [('cb3e2c1e-39b9-4b58-b94c-d8644c9c7ee2', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:30:26.200194 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:30:26.200621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:30:26.201204 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:30:26.201614 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:30:26.202055 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:30:26.211240 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:26.211689 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:26.212489 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:26.212964 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:26.229939 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Getting quotas for project d31c39583b8343bd98bdc64d7659bd9a. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:30:26.233823 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Getting quotas for user 4907ee21ee894003a8a237c99302ed88 and project d31c39583b8343bd98bdc64d7659bd9a. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:30:26.292054 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:30:26.294187 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e9a189f-10d5-46b6-932e-3c7040147d80',volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:30:26.417970 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-263ebef2-aeb0-45d3-aef6-0d6b7ff04828 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.689642 May 10 03:30:26.418602 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 511/1023] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:30:25 2022] POST /compute/v2.1/servers => generated 404 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:30:26.429149 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3b295ce5-4d18-45f8-adf7-00f68393bafb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:26.429804 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3b295ce5-4d18-45f8-adf7-00f68393bafb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:26.485889 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3b295ce5-4d18-45f8-adf7-00f68393bafb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:26.493404 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3b295ce5-4d18-45f8-adf7-00f68393bafb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1094 microversion: 2.1 time: 0.068456 May 10 03:30:26.493974 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 513/1024] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:26 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:27.511183 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-6fb68643-46da-41ea-8de3-926d9a108cd3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:27.511795 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-6fb68643-46da-41ea-8de3-926d9a108cd3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:27.517797 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6fb68643-46da-41ea-8de3-926d9a108cd3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:27.518242 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6fb68643-46da-41ea-8de3-926d9a108cd3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:27.519010 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6fb68643-46da-41ea-8de3-926d9a108cd3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:27.519440 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6fb68643-46da-41ea-8de3-926d9a108cd3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:27.585880 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-6fb68643-46da-41ea-8de3-926d9a108cd3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:27.593295 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-6fb68643-46da-41ea-8de3-926d9a108cd3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1210 microversion: 2.1 time: 0.086407 May 10 03:30:27.593894 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 512/1025] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:27 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:28.611997 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-06fa09fe-67f6-4e70-ac4e-9e634a77a3e4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:28.612615 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-06fa09fe-67f6-4e70-ac4e-9e634a77a3e4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:28.632966 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-06fa09fe-67f6-4e70-ac4e-9e634a77a3e4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:28.633359 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-06fa09fe-67f6-4e70-ac4e-9e634a77a3e4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:28.634313 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-06fa09fe-67f6-4e70-ac4e-9e634a77a3e4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:28.634786 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-06fa09fe-67f6-4e70-ac4e-9e634a77a3e4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:28.678101 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-f5a397b7-b838-4fd0-8350-97e466eefde6 req-a2eb64d3-bdbc-4743-adff-ffa0cb5a88e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ca5f49-d88d-4b77-abf4-03b9742ea505", "tag": "c86770ba-d3d5-4241-88da-51dba0f77837"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:30:28.688508 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-f5a397b7-b838-4fd0-8350-97e466eefde6 req-a2eb64d3-bdbc-4743-adff-ffa0cb5a88e5 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:28.689681 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-f5a397b7-b838-4fd0-8350-97e466eefde6 req-a2eb64d3-bdbc-4743-adff-ffa0cb5a88e5 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:28.704085 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-f5a397b7-b838-4fd0-8350-97e466eefde6 req-a2eb64d3-bdbc-4743-adff-ffa0cb5a88e5 service nova] Creating event network-changed:c86770ba-d3d5-4241-88da-51dba0f77837 for instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 on hv-cinder-83009 May 10 03:30:28.720643 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-f5a397b7-b838-4fd0-8350-97e466eefde6 req-a2eb64d3-bdbc-4743-adff-ffa0cb5a88e5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053468 May 10 03:30:28.723464 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 513/1026] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:30:28.930784 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-06fa09fe-67f6-4e70-ac4e-9e634a77a3e4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:28.944488 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-06fa09fe-67f6-4e70-ac4e-9e634a77a3e4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.336891 May 10 03:30:28.945436 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 514/1027] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:28 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:29.963778 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-dcdc348e-4577-405f-8056-fe540700e0f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:29.964477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-dcdc348e-4577-405f-8056-fe540700e0f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:29.971719 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dcdc348e-4577-405f-8056-fe540700e0f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:29.972169 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dcdc348e-4577-405f-8056-fe540700e0f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:29.973006 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dcdc348e-4577-405f-8056-fe540700e0f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:29.973444 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-dcdc348e-4577-405f-8056-fe540700e0f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:30.114685 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-dcdc348e-4577-405f-8056-fe540700e0f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:30.126125 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-dcdc348e-4577-405f-8056-fe540700e0f6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.166928 May 10 03:30:30.126804 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 514/1028] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:29 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:31.143875 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-fd63fd03-124e-40ae-8710-e8433487f61c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:31.144768 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-fd63fd03-124e-40ae-8710-e8433487f61c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:31.151268 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fd63fd03-124e-40ae-8710-e8433487f61c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:31.151789 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fd63fd03-124e-40ae-8710-e8433487f61c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:31.152562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fd63fd03-124e-40ae-8710-e8433487f61c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:31.153045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-fd63fd03-124e-40ae-8710-e8433487f61c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:31.293725 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-fd63fd03-124e-40ae-8710-e8433487f61c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:31.302573 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-fd63fd03-124e-40ae-8710-e8433487f61c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.163096 May 10 03:30:31.303151 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 515/1029] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:31 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:32.320403 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-081c9529-230a-4808-8993-d01eaaba00aa tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:32.320999 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-081c9529-230a-4808-8993-d01eaaba00aa tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:32.327376 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-081c9529-230a-4808-8993-d01eaaba00aa tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:32.328414 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-081c9529-230a-4808-8993-d01eaaba00aa tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:32.329293 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-081c9529-230a-4808-8993-d01eaaba00aa tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:32.329737 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-081c9529-230a-4808-8993-d01eaaba00aa tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:32.465365 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-081c9529-230a-4808-8993-d01eaaba00aa tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:32.473829 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-081c9529-230a-4808-8993-d01eaaba00aa tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.158319 May 10 03:30:32.474401 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 515/1030] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:32 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:33.491175 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-1cc2605f-ef21-4cf2-945f-ae90a24bf0e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:33.491784 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-1cc2605f-ef21-4cf2-945f-ae90a24bf0e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:33.498326 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1cc2605f-ef21-4cf2-945f-ae90a24bf0e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:33.498817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1cc2605f-ef21-4cf2-945f-ae90a24bf0e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:33.500228 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1cc2605f-ef21-4cf2-945f-ae90a24bf0e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:33.500773 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-1cc2605f-ef21-4cf2-945f-ae90a24bf0e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:33.632783 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-1cc2605f-ef21-4cf2-945f-ae90a24bf0e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:33.640522 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-1cc2605f-ef21-4cf2-945f-ae90a24bf0e5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.153256 May 10 03:30:33.641147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 516/1031] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:33 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:34.657893 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1b27bbf0-4c85-42e4-b7c9-7a66aa29bc59 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:34.658516 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1b27bbf0-4c85-42e4-b7c9-7a66aa29bc59 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:34.665228 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1b27bbf0-4c85-42e4-b7c9-7a66aa29bc59 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:34.665685 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1b27bbf0-4c85-42e4-b7c9-7a66aa29bc59 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:34.666461 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1b27bbf0-4c85-42e4-b7c9-7a66aa29bc59 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:34.666899 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1b27bbf0-4c85-42e4-b7c9-7a66aa29bc59 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:34.812222 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1b27bbf0-4c85-42e4-b7c9-7a66aa29bc59 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:34.819682 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1b27bbf0-4c85-42e4-b7c9-7a66aa29bc59 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.166361 May 10 03:30:34.820251 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 516/1032] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:34 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:35.836822 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-aa1a9df7-d1b3-4615-b4b1-cea30b2219ec tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:35.837424 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-aa1a9df7-d1b3-4615-b4b1-cea30b2219ec tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:35.843998 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-aa1a9df7-d1b3-4615-b4b1-cea30b2219ec tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:35.844483 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-aa1a9df7-d1b3-4615-b4b1-cea30b2219ec tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:35.845313 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-aa1a9df7-d1b3-4615-b4b1-cea30b2219ec tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:35.845747 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-aa1a9df7-d1b3-4615-b4b1-cea30b2219ec tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:35.971855 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-aa1a9df7-d1b3-4615-b4b1-cea30b2219ec tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:35.979092 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-aa1a9df7-d1b3-4615-b4b1-cea30b2219ec tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.146101 May 10 03:30:35.979662 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 517/1033] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:35 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:36.995356 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-999fe801-37f2-4c85-b8d9-ecc225cc4bb3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:36.995974 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-999fe801-37f2-4c85-b8d9-ecc225cc4bb3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:37.002994 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-999fe801-37f2-4c85-b8d9-ecc225cc4bb3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:37.003439 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-999fe801-37f2-4c85-b8d9-ecc225cc4bb3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:37.004232 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-999fe801-37f2-4c85-b8d9-ecc225cc4bb3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:37.004675 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-999fe801-37f2-4c85-b8d9-ecc225cc4bb3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:37.135287 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-999fe801-37f2-4c85-b8d9-ecc225cc4bb3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:37.142744 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-999fe801-37f2-4c85-b8d9-ecc225cc4bb3 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.151243 May 10 03:30:37.143303 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 517/1034] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:36 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:38.159842 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b7083f09-8d7b-4673-91fa-52b46c20e47c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:38.160453 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b7083f09-8d7b-4673-91fa-52b46c20e47c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:38.167045 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b7083f09-8d7b-4673-91fa-52b46c20e47c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:38.167492 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b7083f09-8d7b-4673-91fa-52b46c20e47c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:38.168252 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b7083f09-8d7b-4673-91fa-52b46c20e47c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:38.168699 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b7083f09-8d7b-4673-91fa-52b46c20e47c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:38.300633 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b7083f09-8d7b-4673-91fa-52b46c20e47c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:38.308133 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b7083f09-8d7b-4673-91fa-52b46c20e47c tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.152803 May 10 03:30:38.308808 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 518/1035] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:38 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:39.325645 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f6cebdc0-e166-47bc-a70e-52631c8111e7 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:39.326182 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f6cebdc0-e166-47bc-a70e-52631c8111e7 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:39.333258 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f6cebdc0-e166-47bc-a70e-52631c8111e7 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:39.333700 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f6cebdc0-e166-47bc-a70e-52631c8111e7 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:39.334458 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f6cebdc0-e166-47bc-a70e-52631c8111e7 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:39.334890 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f6cebdc0-e166-47bc-a70e-52631c8111e7 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:39.462437 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f6cebdc0-e166-47bc-a70e-52631c8111e7 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:39.470299 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f6cebdc0-e166-47bc-a70e-52631c8111e7 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.148588 May 10 03:30:39.470863 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 518/1036] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:39 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:40.063108 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-3de5d234-be54-43ad-aa4b-116c1956b19c req-b9c4618c-04c5-4491-994c-6773f5c72393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ca5f49-d88d-4b77-abf4-03b9742ea505", "name": "network-vif-plugged", "status": "completed", "tag": "c86770ba-d3d5-4241-88da-51dba0f77837"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:30:40.071412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-3de5d234-be54-43ad-aa4b-116c1956b19c req-b9c4618c-04c5-4491-994c-6773f5c72393 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:40.071869 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-3de5d234-be54-43ad-aa4b-116c1956b19c req-b9c4618c-04c5-4491-994c-6773f5c72393 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:40.083709 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-3de5d234-be54-43ad-aa4b-116c1956b19c req-b9c4618c-04c5-4491-994c-6773f5c72393 service nova] Creating event network-vif-plugged:c86770ba-d3d5-4241-88da-51dba0f77837 for instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 on hv-cinder-83009 May 10 03:30:40.088773 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-3de5d234-be54-43ad-aa4b-116c1956b19c req-b9c4618c-04c5-4491-994c-6773f5c72393 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029418 May 10 03:30:40.089571 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 519/1037] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:30:40.487160 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b86c7778-96e3-4767-82f2-73be0f14aefc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:40.487775 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b86c7778-96e3-4767-82f2-73be0f14aefc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:40.494118 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b86c7778-96e3-4767-82f2-73be0f14aefc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:40.494571 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b86c7778-96e3-4767-82f2-73be0f14aefc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:40.495343 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b86c7778-96e3-4767-82f2-73be0f14aefc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:40.495781 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b86c7778-96e3-4767-82f2-73be0f14aefc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:40.626479 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-b86c7778-96e3-4767-82f2-73be0f14aefc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:40.633699 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b86c7778-96e3-4767-82f2-73be0f14aefc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1264 microversion: 2.1 time: 0.150574 May 10 03:30:40.634262 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 519/1038] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:40 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:41.651658 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-259b168a-72cb-4966-b7e7-ce0b406c07e2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:41.652385 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-259b168a-72cb-4966-b7e7-ce0b406c07e2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:41.659219 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-259b168a-72cb-4966-b7e7-ce0b406c07e2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:41.659659 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-259b168a-72cb-4966-b7e7-ce0b406c07e2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:41.660415 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-259b168a-72cb-4966-b7e7-ce0b406c07e2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:41.660878 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-259b168a-72cb-4966-b7e7-ce0b406c07e2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:41.795370 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-259b168a-72cb-4966-b7e7-ce0b406c07e2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:41.802789 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-259b168a-72cb-4966-b7e7-ce0b406c07e2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1451 microversion: 2.1 time: 0.155799 May 10 03:30:41.803357 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 520/1039] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:41 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:41.819146 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-78ff13c0-03c3-449a-b0f1-499788a58a60 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:41.819753 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-78ff13c0-03c3-449a-b0f1-499788a58a60 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:41.826808 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-78ff13c0-03c3-449a-b0f1-499788a58a60 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:41.827350 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-78ff13c0-03c3-449a-b0f1-499788a58a60 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:41.828120 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-78ff13c0-03c3-449a-b0f1-499788a58a60 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:41.829655 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-78ff13c0-03c3-449a-b0f1-499788a58a60 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:41.958640 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-78ff13c0-03c3-449a-b0f1-499788a58a60 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:41.965901 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-78ff13c0-03c3-449a-b0f1-499788a58a60 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1451 microversion: 2.1 time: 0.150585 May 10 03:30:41.966462 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 520/1040] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:30:41 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:43.872354 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-066feaf7-1e13-4f66-909d-4fd1e25503b1 req-cabf2c7d-5be1-428d-ba43-5da7c600aa18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ca5f49-d88d-4b77-abf4-03b9742ea505", "tag": "c86770ba-d3d5-4241-88da-51dba0f77837"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:30:43.880496 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-066feaf7-1e13-4f66-909d-4fd1e25503b1 req-cabf2c7d-5be1-428d-ba43-5da7c600aa18 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:43.880939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-066feaf7-1e13-4f66-909d-4fd1e25503b1 req-cabf2c7d-5be1-428d-ba43-5da7c600aa18 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:43.892309 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-066feaf7-1e13-4f66-909d-4fd1e25503b1 req-cabf2c7d-5be1-428d-ba43-5da7c600aa18 service nova] Creating event network-changed:c86770ba-d3d5-4241-88da-51dba0f77837 for instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 on hv-cinder-83009 May 10 03:30:43.897319 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-066feaf7-1e13-4f66-909d-4fd1e25503b1 req-cabf2c7d-5be1-428d-ba43-5da7c600aa18 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106664 May 10 03:30:43.897902 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 521/1041] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:31:13.082053 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:31:13.082566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Tue May 10 03:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:31:54.815226 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:31:54.815849 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Tue May 10 03:31:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:04.465062 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:32:04.465688 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Tue May 10 03:32:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:32.761955 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-41526064", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1710297732", "security_groups": [{"name": "tempest-secgroup-smoke-41511010"}], "block_device_mapping_v2": [{"uuid": "907b0490-c85e-4476-a990-13c3ca9cadc1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb3e2c1e-39b9-4b58-b94c-d8644c9c7ee2"}]}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:32:32.990162 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.network.neutron [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] validate_networks() for [('cb3e2c1e-39b9-4b58-b94c-d8644c9c7ee2', None, None, None, None, None)] {{(pid=117119) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:32:33.346234 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Flavor limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:32:33.346653 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Image limits 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:32:33.347149 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Flavor pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:32:33.347554 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Image pref 0:0:0 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:32:33.347979 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.virt.hardware [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:32:33.356700 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:33.357160 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:33.357971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:33.358412 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:33.375110 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Getting quotas for project d31c39583b8343bd98bdc64d7659bd9a. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:32:33.379477 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.quota [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Getting quotas for user 4907ee21ee894003a8a237c99302ed88 and project d31c39583b8343bd98bdc64d7659bd9a. Resources: {'ram', 'instances', 'cores'} {{(pid=117119) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:32:33.435202 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Going to run 1 instances... {{(pid=117119) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:32:33.437325 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='907b0490-c85e-4476-a990-13c3ca9cadc1',volume_size=None,volume_type=None)] {{(pid=117119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:32:33.559055 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5032ba40-901c-494c-b2cc-80dad2eae2d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.801875 May 10 03:32:33.559692 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 521/1042] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 10 03:32:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:32:33.567805 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6bbf5464-76a4-4d4b-a380-8e24d3c3ced2] AMQP server on 10.222.0.55:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 10 03:32:33.571849 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-0e914fe0-785e-492d-b604-ce07e052b6a2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:33.572551 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-0e914fe0-785e-492d-b604-ce07e052b6a2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:33.681264 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-0e914fe0-785e-492d-b604-ce07e052b6a2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:33.688885 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-0e914fe0-785e-492d-b604-ce07e052b6a2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1093 microversion: 2.1 time: 0.122327 May 10 03:32:33.689599 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 522/1043] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:33 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1093 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:34.706623 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-181c6131-7ade-472c-9e48-e4cde3872e7e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:34.707232 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-181c6131-7ade-472c-9e48-e4cde3872e7e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:34.713561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-181c6131-7ade-472c-9e48-e4cde3872e7e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:34.714007 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-181c6131-7ade-472c-9e48-e4cde3872e7e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:34.714776 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-181c6131-7ade-472c-9e48-e4cde3872e7e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:34.715216 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-181c6131-7ade-472c-9e48-e4cde3872e7e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:34.780016 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-181c6131-7ade-472c-9e48-e4cde3872e7e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:34.789296 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-181c6131-7ade-472c-9e48-e4cde3872e7e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1209 microversion: 2.1 time: 0.087440 May 10 03:32:34.789896 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 522/1044] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:34 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:35.805764 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e23498ac-7ef3-4bc9-b645-20bbac81c228 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:35.806381 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-e23498ac-7ef3-4bc9-b645-20bbac81c228 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:35.815821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e23498ac-7ef3-4bc9-b645-20bbac81c228 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:35.816278 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e23498ac-7ef3-4bc9-b645-20bbac81c228 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:35.817096 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e23498ac-7ef3-4bc9-b645-20bbac81c228 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:35.817545 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-e23498ac-7ef3-4bc9-b645-20bbac81c228 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:35.823542 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] [6bbf5464-76a4-4d4b-a380-8e24d3c3ced2] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 45244. May 10 03:32:36.033718 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-e23498ac-7ef3-4bc9-b645-20bbac81c228 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:36.041394 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e23498ac-7ef3-4bc9-b645-20bbac81c228 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.239528 May 10 03:32:36.041964 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 523/1045] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:35 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:36.242770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [req-4178702c-77dc-48ec-8c05-851c1174c096 req-f9d11c92-978b-4225-8368-af77e561bc3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b299f2-f138-43b1-9621-cc6c3d5f2d13", "tag": "3cd32790-adca-4e0e-ad5f-c24fa3e3530d"}]} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:32:36.251789 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-4178702c-77dc-48ec-8c05-851c1174c096 req-f9d11c92-978b-4225-8368-af77e561bc3c service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:36.252339 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [req-4178702c-77dc-48ec-8c05-851c1174c096 req-f9d11c92-978b-4225-8368-af77e561bc3c service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:36.263872 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.compute.server_external_events [req-4178702c-77dc-48ec-8c05-851c1174c096 req-f9d11c92-978b-4225-8368-af77e561bc3c service nova] Creating event network-changed:3cd32790-adca-4e0e-ad5f-c24fa3e3530d for instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 on hv-cinder-83009 May 10 03:32:36.269035 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR oslo.messaging._drivers.impl_rabbit [req-4178702c-77dc-48ec-8c05-851c1174c096 req-f9d11c92-978b-4225-8368-af77e561bc3c service nova] [be354871-6880-4ef2-96ec-9a3591dc737c] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:32:37.057897 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f22d2d7c-f876-4537-9017-74d106f264df tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:37.058508 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f22d2d7c-f876-4537-9017-74d106f264df tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:37.065711 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f22d2d7c-f876-4537-9017-74d106f264df tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:37.066165 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f22d2d7c-f876-4537-9017-74d106f264df tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:37.066939 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f22d2d7c-f876-4537-9017-74d106f264df tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:37.067376 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f22d2d7c-f876-4537-9017-74d106f264df tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:37.194749 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f22d2d7c-f876-4537-9017-74d106f264df tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:37.202136 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f22d2d7c-f876-4537-9017-74d106f264df tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.148146 May 10 03:32:37.202705 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 524/1046] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:37 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:32:37.277148 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [req-4178702c-77dc-48ec-8c05-851c1174c096 req-f9d11c92-978b-4225-8368-af77e561bc3c service nova] [be354871-6880-4ef2-96ec-9a3591dc737c] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 45252. May 10 03:32:37.280588 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [req-4178702c-77dc-48ec-8c05-851c1174c096 req-f9d11c92-978b-4225-8368-af77e561bc3c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.125610 May 10 03:32:37.281209 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 523/1047] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:32:38.219245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b9b79b14-33ec-4fbc-9acf-650c1ce0e52b tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:38.220003 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b9b79b14-33ec-4fbc-9acf-650c1ce0e52b tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:38.226157 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b9b79b14-33ec-4fbc-9acf-650c1ce0e52b tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:38.226602 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b9b79b14-33ec-4fbc-9acf-650c1ce0e52b tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:38.227392 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b9b79b14-33ec-4fbc-9acf-650c1ce0e52b tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:38.227825 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b9b79b14-33ec-4fbc-9acf-650c1ce0e52b tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:38.358352 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-b9b79b14-33ec-4fbc-9acf-650c1ce0e52b tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:38.365838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b9b79b14-33ec-4fbc-9acf-650c1ce0e52b tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.150520 May 10 03:32:38.366411 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 525/1048] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:38 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:39.383712 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f686572c-e34b-42c3-976a-e4f6ba11af8d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:39.384321 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f686572c-e34b-42c3-976a-e4f6ba11af8d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:39.390582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f686572c-e34b-42c3-976a-e4f6ba11af8d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:39.391579 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f686572c-e34b-42c3-976a-e4f6ba11af8d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:39.392338 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f686572c-e34b-42c3-976a-e4f6ba11af8d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:39.392796 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f686572c-e34b-42c3-976a-e4f6ba11af8d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:39.524583 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f686572c-e34b-42c3-976a-e4f6ba11af8d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:39.532066 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f686572c-e34b-42c3-976a-e4f6ba11af8d tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.153000 May 10 03:32:39.532720 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 524/1049] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:39 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:40.548891 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2f2201bf-c77a-4189-9152-6a69372345dc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:40.549504 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-2f2201bf-c77a-4189-9152-6a69372345dc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:40.555817 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f2201bf-c77a-4189-9152-6a69372345dc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:40.556265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f2201bf-c77a-4189-9152-6a69372345dc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:40.557068 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f2201bf-c77a-4189-9152-6a69372345dc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:40.557505 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-2f2201bf-c77a-4189-9152-6a69372345dc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:40.686562 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-2f2201bf-c77a-4189-9152-6a69372345dc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:40.695041 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2f2201bf-c77a-4189-9152-6a69372345dc tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.150561 May 10 03:32:40.696018 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 526/1050] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:40 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:32:41.718557 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1fb6ec4e-317b-4ee9-85f0-c68dd967eb71 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:41.719748 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1fb6ec4e-317b-4ee9-85f0-c68dd967eb71 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:41.726262 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1fb6ec4e-317b-4ee9-85f0-c68dd967eb71 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:41.726709 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1fb6ec4e-317b-4ee9-85f0-c68dd967eb71 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:41.727469 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1fb6ec4e-317b-4ee9-85f0-c68dd967eb71 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:41.727904 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1fb6ec4e-317b-4ee9-85f0-c68dd967eb71 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:41.855261 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1fb6ec4e-317b-4ee9-85f0-c68dd967eb71 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:41.862654 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1fb6ec4e-317b-4ee9-85f0-c68dd967eb71 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.147954 May 10 03:32:41.863223 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 525/1051] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:41 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:42.879554 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f66491b6-53fa-4300-98b7-a138e17c60f5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:42.880172 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-f66491b6-53fa-4300-98b7-a138e17c60f5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:42.886558 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f66491b6-53fa-4300-98b7-a138e17c60f5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:42.887006 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f66491b6-53fa-4300-98b7-a138e17c60f5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:42.887774 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f66491b6-53fa-4300-98b7-a138e17c60f5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:42.888210 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-f66491b6-53fa-4300-98b7-a138e17c60f5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:43.015681 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-f66491b6-53fa-4300-98b7-a138e17c60f5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:43.023438 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f66491b6-53fa-4300-98b7-a138e17c60f5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.147947 May 10 03:32:43.024014 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 527/1052] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:42 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:44.041434 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-aaba6c1c-ba28-40a3-b831-c1882919c1ad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:44.042065 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-aaba6c1c-ba28-40a3-b831-c1882919c1ad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:44.048945 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aaba6c1c-ba28-40a3-b831-c1882919c1ad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:44.049400 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aaba6c1c-ba28-40a3-b831-c1882919c1ad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:44.050213 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aaba6c1c-ba28-40a3-b831-c1882919c1ad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:44.050650 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-aaba6c1c-ba28-40a3-b831-c1882919c1ad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:44.178335 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-aaba6c1c-ba28-40a3-b831-c1882919c1ad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:44.185621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-aaba6c1c-ba28-40a3-b831-c1882919c1ad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.148728 May 10 03:32:44.186187 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 526/1053] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:44 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:45.202091 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9af840f5-0758-4683-94bd-d0c1aa2e81cb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:45.202694 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-9af840f5-0758-4683-94bd-d0c1aa2e81cb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:45.209135 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9af840f5-0758-4683-94bd-d0c1aa2e81cb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:45.209584 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9af840f5-0758-4683-94bd-d0c1aa2e81cb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:45.210339 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9af840f5-0758-4683-94bd-d0c1aa2e81cb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:45.210773 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-9af840f5-0758-4683-94bd-d0c1aa2e81cb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:45.336923 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-9af840f5-0758-4683-94bd-d0c1aa2e81cb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:45.345392 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9af840f5-0758-4683-94bd-d0c1aa2e81cb tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.145992 May 10 03:32:45.345963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 528/1054] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:45 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:46.362495 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d83d0276-879e-4018-bd2b-095e9e0cc8d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:46.363113 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-d83d0276-879e-4018-bd2b-095e9e0cc8d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:46.369607 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d83d0276-879e-4018-bd2b-095e9e0cc8d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:46.370059 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d83d0276-879e-4018-bd2b-095e9e0cc8d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:46.370832 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d83d0276-879e-4018-bd2b-095e9e0cc8d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:46.371272 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-d83d0276-879e-4018-bd2b-095e9e0cc8d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:46.502666 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-d83d0276-879e-4018-bd2b-095e9e0cc8d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:46.509975 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d83d0276-879e-4018-bd2b-095e9e0cc8d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.152160 May 10 03:32:46.510537 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 527/1055] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:46 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:46.750655 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-512429e6-d472-4023-9094-5fd8174937a7 req-808ad67b-32f0-47ef-8bde-43f7d41062c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b299f2-f138-43b1-9621-cc6c3d5f2d13", "name": "network-vif-plugged", "status": "completed", "tag": "3cd32790-adca-4e0e-ad5f-c24fa3e3530d"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:32:46.758772 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-512429e6-d472-4023-9094-5fd8174937a7 req-808ad67b-32f0-47ef-8bde-43f7d41062c7 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:46.759214 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-512429e6-d472-4023-9094-5fd8174937a7 req-808ad67b-32f0-47ef-8bde-43f7d41062c7 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:46.771191 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-512429e6-d472-4023-9094-5fd8174937a7 req-808ad67b-32f0-47ef-8bde-43f7d41062c7 service nova] Creating event network-vif-plugged:3cd32790-adca-4e0e-ad5f-c24fa3e3530d for instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 on hv-cinder-83009 May 10 03:32:46.774630 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR oslo.messaging._drivers.impl_rabbit [req-512429e6-d472-4023-9094-5fd8174937a7 req-808ad67b-32f0-47ef-8bde-43f7d41062c7 service nova] [026e1d16-1ac9-4d15-9ed1-7372d7098a2a] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:32:47.526456 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8807f98d-4154-4e88-a656-6940f1264f79 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:47.527067 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-8807f98d-4154-4e88-a656-6940f1264f79 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:47.533566 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8807f98d-4154-4e88-a656-6940f1264f79 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:47.534009 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8807f98d-4154-4e88-a656-6940f1264f79 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:47.534846 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8807f98d-4154-4e88-a656-6940f1264f79 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:47.535274 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-8807f98d-4154-4e88-a656-6940f1264f79 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:47.663532 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-8807f98d-4154-4e88-a656-6940f1264f79 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:47.670700 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8807f98d-4154-4e88-a656-6940f1264f79 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.148090 May 10 03:32:47.671271 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 528/1056] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:47 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:32:47.782164 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [req-512429e6-d472-4023-9094-5fd8174937a7 req-808ad67b-32f0-47ef-8bde-43f7d41062c7 service nova] [026e1d16-1ac9-4d15-9ed1-7372d7098a2a] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 45276. May 10 03:32:47.785248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-512429e6-d472-4023-9094-5fd8174937a7 req-808ad67b-32f0-47ef-8bde-43f7d41062c7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.093989 May 10 03:32:47.785853 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 529/1057] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:32:48.687275 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1143aefb-5712-4753-adfb-09e808a082d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:48.687920 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-1143aefb-5712-4753-adfb-09e808a082d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:48.694360 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1143aefb-5712-4753-adfb-09e808a082d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:48.694811 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1143aefb-5712-4753-adfb-09e808a082d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:48.695574 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1143aefb-5712-4753-adfb-09e808a082d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:48.696009 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-1143aefb-5712-4753-adfb-09e808a082d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:48.825811 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-1143aefb-5712-4753-adfb-09e808a082d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:48.833176 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1143aefb-5712-4753-adfb-09e808a082d2 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1263 microversion: 2.1 time: 0.149789 May 10 03:32:48.833755 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 529/1058] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:48 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:49.850632 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-3b40fbaa-5ae1-40b1-a2a2-956e1c1f5503 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:49.851329 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-3b40fbaa-5ae1-40b1-a2a2-956e1c1f5503 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:49.857575 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3b40fbaa-5ae1-40b1-a2a2-956e1c1f5503 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:49.858025 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3b40fbaa-5ae1-40b1-a2a2-956e1c1f5503 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:49.858789 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3b40fbaa-5ae1-40b1-a2a2-956e1c1f5503 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:49.859222 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-3b40fbaa-5ae1-40b1-a2a2-956e1c1f5503 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:49.987703 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-3b40fbaa-5ae1-40b1-a2a2-956e1c1f5503 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:49.995049 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-3b40fbaa-5ae1-40b1-a2a2-956e1c1f5503 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1449 microversion: 2.1 time: 0.149124 May 10 03:32:49.995611 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 530/1059] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:49 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:50.011396 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f0acc4c6-d62b-4ce5-9366-7e40ca5b5043 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:50.012071 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-f0acc4c6-d62b-4ce5-9366-7e40ca5b5043 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:50.018431 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f0acc4c6-d62b-4ce5-9366-7e40ca5b5043 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:50.018885 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f0acc4c6-d62b-4ce5-9366-7e40ca5b5043 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:50.019663 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f0acc4c6-d62b-4ce5-9366-7e40ca5b5043 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:50.020104 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-f0acc4c6-d62b-4ce5-9366-7e40ca5b5043 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:50.150341 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-f0acc4c6-d62b-4ce5-9366-7e40ca5b5043 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:50.157971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f0acc4c6-d62b-4ce5-9366-7e40ca5b5043 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1449 microversion: 2.1 time: 0.150381 May 10 03:32:50.158542 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 530/1060] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:32:50 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:51.755755 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-80dd2e3b-9bfd-4cc6-a3eb-7bf1b1f80d13 req-ec7c3a5c-0832-4ab9-89af-b8f3ff440c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b299f2-f138-43b1-9621-cc6c3d5f2d13", "tag": "3cd32790-adca-4e0e-ad5f-c24fa3e3530d"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:32:51.764370 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-80dd2e3b-9bfd-4cc6-a3eb-7bf1b1f80d13 req-ec7c3a5c-0832-4ab9-89af-b8f3ff440c55 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:51.764851 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-80dd2e3b-9bfd-4cc6-a3eb-7bf1b1f80d13 req-ec7c3a5c-0832-4ab9-89af-b8f3ff440c55 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:51.777328 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-80dd2e3b-9bfd-4cc6-a3eb-7bf1b1f80d13 req-ec7c3a5c-0832-4ab9-89af-b8f3ff440c55 service nova] Creating event network-changed:3cd32790-adca-4e0e-ad5f-c24fa3e3530d for instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 on hv-cinder-83009 May 10 03:32:51.782532 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-80dd2e3b-9bfd-4cc6-a3eb-7bf1b1f80d13 req-ec7c3a5c-0832-4ab9-89af-b8f3ff440c55 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031148 May 10 03:32:51.783172 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 531/1061] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:34:20.282349 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-6160afa3-a844-4ef1-b5cf-95757dffaf03 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:20.283593 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-6160afa3-a844-4ef1-b5cf-95757dffaf03 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:20.286180 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-d3318391-e2ec-4d1b-a398-e19319e75ed2 req-be46c2c5-f401-4e55-8153-a94424a660c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b299f2-f138-43b1-9621-cc6c3d5f2d13", "tag": "3cd32790-adca-4e0e-ad5f-c24fa3e3530d"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:34:20.290201 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6160afa3-a844-4ef1-b5cf-95757dffaf03 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:20.291626 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6160afa3-a844-4ef1-b5cf-95757dffaf03 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:20.292416 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6160afa3-a844-4ef1-b5cf-95757dffaf03 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:20.292874 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-6160afa3-a844-4ef1-b5cf-95757dffaf03 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:20.294688 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-d3318391-e2ec-4d1b-a398-e19319e75ed2 req-be46c2c5-f401-4e55-8153-a94424a660c7 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:20.295132 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-d3318391-e2ec-4d1b-a398-e19319e75ed2 req-be46c2c5-f401-4e55-8153-a94424a660c7 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:20.306398 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-d3318391-e2ec-4d1b-a398-e19319e75ed2 req-be46c2c5-f401-4e55-8153-a94424a660c7 service nova] Creating event network-changed:3cd32790-adca-4e0e-ad5f-c24fa3e3530d for instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 on hv-cinder-83009 May 10 03:34:20.312147 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-d3318391-e2ec-4d1b-a398-e19319e75ed2 req-be46c2c5-f401-4e55-8153-a94424a660c7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031010 May 10 03:34:20.313040 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 532/1062] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:34:20.322192 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-6160afa3-a844-4ef1-b5cf-95757dffaf03 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:34:20.410920 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-6160afa3-a844-4ef1-b5cf-95757dffaf03 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 204 len: 0 microversion: 2.1 time: 0.133626 May 10 03:34:20.411708 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 531/1063] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:34:20 2022] DELETE /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:34:20.420695 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d127b818-0397-4225-8f76-66d9bfedbce6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:20.421074 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d127b818-0397-4225-8f76-66d9bfedbce6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:20.428103 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d127b818-0397-4225-8f76-66d9bfedbce6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:20.428553 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d127b818-0397-4225-8f76-66d9bfedbce6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:20.429352 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d127b818-0397-4225-8f76-66d9bfedbce6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:20.429793 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d127b818-0397-4225-8f76-66d9bfedbce6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:20.579636 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d127b818-0397-4225-8f76-66d9bfedbce6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:34:20.587093 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d127b818-0397-4225-8f76-66d9bfedbce6 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1572 microversion: 2.1 time: 0.170912 May 10 03:34:20.587660 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 533/1064] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:34:20 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:34:21.605579 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-43928d64-8804-4231-9c21-1b534334aa33 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:21.606286 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-43928d64-8804-4231-9c21-1b534334aa33 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:21.613940 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-43928d64-8804-4231-9c21-1b534334aa33 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:21.614394 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-43928d64-8804-4231-9c21-1b534334aa33 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:21.615182 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-43928d64-8804-4231-9c21-1b534334aa33 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:21.615621 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-43928d64-8804-4231-9c21-1b534334aa33 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:21.745686 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-43928d64-8804-4231-9c21-1b534334aa33 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:34:21.753878 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-43928d64-8804-4231-9c21-1b534334aa33 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1572 microversion: 2.1 time: 0.152636 May 10 03:34:21.754446 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 532/1065] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:34:21 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:34:22.596188 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-934480c5-2bb9-4985-ba4a-e6a2d405b05c req-40e5ee05-f81e-4e16-9e54-ff1deb220920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b299f2-f138-43b1-9621-cc6c3d5f2d13", "name": "network-vif-deleted", "tag": "3cd32790-adca-4e0e-ad5f-c24fa3e3530d"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:34:22.604821 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-934480c5-2bb9-4985-ba4a-e6a2d405b05c req-40e5ee05-f81e-4e16-9e54-ff1deb220920 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:22.605275 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-934480c5-2bb9-4985-ba4a-e6a2d405b05c req-40e5ee05-f81e-4e16-9e54-ff1deb220920 service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:22.616963 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-934480c5-2bb9-4985-ba4a-e6a2d405b05c req-40e5ee05-f81e-4e16-9e54-ff1deb220920 service nova] Creating event network-vif-deleted:3cd32790-adca-4e0e-ad5f-c24fa3e3530d for instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 on hv-cinder-83009 May 10 03:34:22.622265 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-934480c5-2bb9-4985-ba4a-e6a2d405b05c req-40e5ee05-f81e-4e16-9e54-ff1deb220920 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029797 May 10 03:34:22.622870 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 534/1066] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:34:22.771500 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e3a84fb0-513d-4dae-9063-c791f77ee8e8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:22.772110 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-e3a84fb0-513d-4dae-9063-c791f77ee8e8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:22.778524 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e3a84fb0-513d-4dae-9063-c791f77ee8e8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:22.778971 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e3a84fb0-513d-4dae-9063-c791f77ee8e8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:22.779757 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e3a84fb0-513d-4dae-9063-c791f77ee8e8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:22.780187 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-e3a84fb0-513d-4dae-9063-c791f77ee8e8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:22.843218 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-e3a84fb0-513d-4dae-9063-c791f77ee8e8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:34:22.851241 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e3a84fb0-513d-4dae-9063-c791f77ee8e8 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 200 len: 1224 microversion: 2.1 time: 0.083883 May 10 03:34:22.851795 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 533/1067] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:34:22 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:34:23.868902 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:23.869596 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: e6b299f2-f138-43b1-9621-cc6c3d5f2d13] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:23.875764 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:23.876204 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:23.877007 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:23.877442 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:23.890228 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] HTTP exception thrown: Instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 could not be found. May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Request method failure captured: May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 HTTP/1.1 May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABieduz-Xd8ueY2TLU1VtmyFlt6hHe9mb_ARmIA24hWk-SoP4Y-kiHb0_NHXNKDwJLPDmXwToJQBGHaL6L4ypuT341VxQMSyuHUTfw8MTsnUyWuKj0Ic8Oj3RRM25BBxQjHq9CFrTsscAsm6_Rz3DorjxzRTfIVITSy_MQmWm3i_3WVowo May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:34:23.891838 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d31c39583b8343bd98bdc64d7659bd9a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d31c39583b8343bd98bdc64d7659bd9a"}]}] May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-TestVolumeBootPattern-271887619 May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-TestVolumeBootPattern-271887619-project May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 4907ee21ee894003a8a237c99302ed88 May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-TestVolumeBootPattern-271887619-project May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 could not be found. May 10 03:34:23.893861 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': 'e6b299f2-f138-43b1-9621-cc6c3d5f2d13'} May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 could not be found. May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:34:23.894686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 could not be found. May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 could not be found. May 10 03:34:23.896412 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:23.898009 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Returning 404 to user: Instance e6b299f2-f138-43b1-9621-cc6c3d5f2d13 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:34:23.898009 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-af5ba5d6-a945-4077-ae57-8e54340b8c0e tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13" status: 404 len: 111 microversion: 2.1 time: 0.029507 May 10 03:34:23.898009 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 535/1068] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:34:23 2022] GET /compute/v2.1/servers/e6b299f2-f138-43b1-9621-cc6c3d5f2d13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:34:27.134678 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b0998fb5-82c4-4533-96ed-18157521a214 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:27.135196 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b0998fb5-82c4-4533-96ed-18157521a214 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:27.136253 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-3f79e914-6777-4abc-af10-c3a9468ba435 req-4e0ccddc-73c7-4eac-86c8-b9966d39e58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ca5f49-d88d-4b77-abf4-03b9742ea505", "tag": "c86770ba-d3d5-4241-88da-51dba0f77837"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:34:27.141385 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b0998fb5-82c4-4533-96ed-18157521a214 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:27.141841 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b0998fb5-82c4-4533-96ed-18157521a214 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:27.143378 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b0998fb5-82c4-4533-96ed-18157521a214 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:27.143829 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-b0998fb5-82c4-4533-96ed-18157521a214 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:27.145243 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-3f79e914-6777-4abc-af10-c3a9468ba435 req-4e0ccddc-73c7-4eac-86c8-b9966d39e58d service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:27.145686 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-3f79e914-6777-4abc-af10-c3a9468ba435 req-4e0ccddc-73c7-4eac-86c8-b9966d39e58d service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:27.159199 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-3f79e914-6777-4abc-af10-c3a9468ba435 req-4e0ccddc-73c7-4eac-86c8-b9966d39e58d service nova] Creating event network-changed:c86770ba-d3d5-4241-88da-51dba0f77837 for instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 on hv-cinder-83009 May 10 03:34:27.165116 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-3f79e914-6777-4abc-af10-c3a9468ba435 req-4e0ccddc-73c7-4eac-86c8-b9966d39e58d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032597 May 10 03:34:27.165803 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 536/1069] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:34:27.172302 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-b0998fb5-82c4-4533-96ed-18157521a214 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Going to try to terminate instance {{(pid=117119) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:34:27.263417 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b0998fb5-82c4-4533-96ed-18157521a214 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "DELETE /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 204 len: 0 microversion: 2.1 time: 0.132616 May 10 03:34:27.265454 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 534/1070] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:34:27 2022] DELETE /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:34:27.276684 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-d985f767-bc16-4b52-928d-1fff39505fe5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:27.277763 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-d985f767-bc16-4b52-928d-1fff39505fe5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:27.285460 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d985f767-bc16-4b52-928d-1fff39505fe5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:27.286204 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d985f767-bc16-4b52-928d-1fff39505fe5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:27.287327 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d985f767-bc16-4b52-928d-1fff39505fe5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:27.289931 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-d985f767-bc16-4b52-928d-1fff39505fe5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:27.429974 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.policy [None req-d985f767-bc16-4b52-928d-1fff39505fe5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117120) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:34:27.437470 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-d985f767-bc16-4b52-928d-1fff39505fe5 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1576 microversion: 2.1 time: 0.167145 May 10 03:34:27.438332 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 537/1071] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:34:27 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:34:28.456073 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-38689e7c-7e99-4d23-adae-9ef337d91e43 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:28.456792 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-38689e7c-7e99-4d23-adae-9ef337d91e43 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:28.463072 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-38689e7c-7e99-4d23-adae-9ef337d91e43 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:28.463523 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-38689e7c-7e99-4d23-adae-9ef337d91e43 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:28.464303 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-38689e7c-7e99-4d23-adae-9ef337d91e43 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:28.464769 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-38689e7c-7e99-4d23-adae-9ef337d91e43 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:28.600275 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-38689e7c-7e99-4d23-adae-9ef337d91e43 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:34:28.610379 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-38689e7c-7e99-4d23-adae-9ef337d91e43 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1576 microversion: 2.1 time: 0.159312 May 10 03:34:28.611029 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 535/1072] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:34:28 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:34:29.151869 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [req-fb46e67f-b109-4c6b-91c1-390bb6652731 req-261f192e-8158-452d-9b1e-6edd5516b91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ca5f49-d88d-4b77-abf4-03b9742ea505", "name": "network-vif-deleted", "tag": "c86770ba-d3d5-4241-88da-51dba0f77837"}]} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:34:29.160728 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-fb46e67f-b109-4c6b-91c1-390bb6652731 req-261f192e-8158-452d-9b1e-6edd5516b91b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:29.161251 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [req-fb46e67f-b109-4c6b-91c1-390bb6652731 req-261f192e-8158-452d-9b1e-6edd5516b91b service nova] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:29.173234 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.compute.server_external_events [req-fb46e67f-b109-4c6b-91c1-390bb6652731 req-261f192e-8158-452d-9b1e-6edd5516b91b service nova] Creating event network-vif-deleted:c86770ba-d3d5-4241-88da-51dba0f77837 for instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 on hv-cinder-83009 May 10 03:34:29.181123 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [req-fb46e67f-b109-4c6b-91c1-390bb6652731 req-261f192e-8158-452d-9b1e-6edd5516b91b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033043 May 10 03:34:29.181720 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 538/1073] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 10 03:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:34:29.627152 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:29.627817 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:29.634925 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:29.635366 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:29.636129 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:29.636561 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:29.668753 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:29.669249 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:29.669626 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.objects.instance [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lazy-loading 'fault' on Instance uuid 33ca5f49-d88d-4b77-abf4-03b9742ea505 {{(pid=117119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:34:29.711890 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.policy [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4907ee21ee894003a8a237c99302ed88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31c39583b8343bd98bdc64d7659bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117119) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:34:29.719582 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-9ebd1ef1-3f88-4138-a99c-d969d48c22fd tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 200 len: 1230 microversion: 2.1 time: 0.096426 May 10 03:34:29.720253 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 536/1074] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:34:29 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:34:30.739356 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:30.740077 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: 33ca5f49-d88d-4b77-abf4-03b9742ea505] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:30.746579 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:30.747104 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:30.747809 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:30.748245 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:30.761941 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] HTTP exception thrown: Instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 could not be found. May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Request method failure captured: May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 HTTP/1.1 May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABieduz-Xd8ueY2TLU1VtmyFlt6hHe9mb_ARmIA24hWk-SoP4Y-kiHb0_NHXNKDwJLPDmXwToJQBGHaL6L4ypuT341VxQMSyuHUTfw8MTsnUyWuKj0Ic8Oj3RRM25BBxQjHq9CFrTsscAsm6_Rz3DorjxzRTfIVITSy_MQmWm3i_3WVowo May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:34:30.763572 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d31c39583b8343bd98bdc64d7659bd9a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d31c39583b8343bd98bdc64d7659bd9a"}]}] May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-TestVolumeBootPattern-271887619 May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-TestVolumeBootPattern-271887619-project May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 4907ee21ee894003a8a237c99302ed88 May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-TestVolumeBootPattern-271887619-project May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 could not be found. May 10 03:34:30.765248 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': '33ca5f49-d88d-4b77-abf4-03b9742ea505'} May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 could not be found. May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:34:30.766236 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 could not be found. May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 could not be found. May 10 03:34:30.768170 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:30.769799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Returning 404 to user: Instance 33ca5f49-d88d-4b77-abf4-03b9742ea505 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:34:30.769799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b28b6264-2d81-4bac-9343-ab6d08afd9ae tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505" status: 404 len: 111 microversion: 2.1 time: 0.031101 May 10 03:34:30.769799 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 539/1075] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:34:30 2022] GET /compute/v2.1/servers/33ca5f49-d88d-4b77-abf4-03b9742ea505 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:34:31.196419 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:31.196982 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.compute.api [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117119) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:31.203452 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:31.203895 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:31.204670 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:31.205788 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:31.221770 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] HTTP exception thrown: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Request method failure captured: May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: request: DELETE /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e HTTP/1.1 May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept: application/json May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Accept-Encoding: identity May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Connection: close May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Length: 0 May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Content-Type: application/json May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Host: 10.222.0.55 May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: User-Agent: python-urllib3/1.26.9 May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABieduz-Xd8ueY2TLU1VtmyFlt6hHe9mb_ARmIA24hWk-SoP4Y-kiHb0_NHXNKDwJLPDmXwToJQBGHaL6L4ypuT341VxQMSyuHUTfw8MTsnUyWuKj0Ic8Oj3RRM25BBxQjHq9CFrTsscAsm6_Rz3DorjxzRTfIVITSy_MQmWm3i_3WVowo May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Id: None May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Domain-Name: None May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Project-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Role: member,reader May 10 03:34:31.223428 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Roles: member,reader May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d31c39583b8343bd98bdc64d7659bd9a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d31c39583b8343bd98bdc64d7659bd9a"}]}] May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant: tempest-TestVolumeBootPattern-271887619 May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-Tenant-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User: tempest-TestVolumeBootPattern-271887619-project May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Id: 4907ee21ee894003a8a237c99302ed88 May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: X-User-Name: tempest-TestVolumeBootPattern-271887619-project May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: method: > May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: exception: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.225285 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: action_args: {'id': 'f843def1-c182-4652-bac3-37e5d494cb3e'} May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:34:31.226405 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.229143 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi May 10 03:34:31.232924 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Returning 404 to user: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:34:31.232924 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-5ab0443b-b09c-4dfd-b9d2-9d5f31dc1b07 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 404 len: 111 microversion: 2.1 time: 0.032376 May 10 03:34:31.232924 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 537/1076] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 10 03:34:31 2022] DELETE /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:34:31.244259 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:31.244898 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.compute.api [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [instance: f843def1-c182-4652-bac3-37e5d494cb3e] Fetching instance by UUID {{(pid=117120) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:34:31.250828 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:31.251272 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:31.252036 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:34:31.252560 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Lock "a3598736-4bcc-4a19-a7cb-e3b3f613b640" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:34:31.265591 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] HTTP exception thrown: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Request method failure captured: May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e HTTP/1.1 May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept: application/json May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Accept-Encoding: identity May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Connection: close May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Length: 0 May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Content-Type: application/json May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Host: 10.222.0.55 May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: User-Agent: python-urllib3/1.26.9 May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABieduz-Xd8ueY2TLU1VtmyFlt6hHe9mb_ARmIA24hWk-SoP4Y-kiHb0_NHXNKDwJLPDmXwToJQBGHaL6L4ypuT341VxQMSyuHUTfw8MTsnUyWuKj0Ic8Oj3RRM25BBxQjHq9CFrTsscAsm6_Rz3DorjxzRTfIVITSy_MQmWm3i_3WVowo May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Id: None May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Domain-Name: None May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Project-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Role: member,reader May 10 03:34:31.267099 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Roles: member,reader May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d31c39583b8343bd98bdc64d7659bd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d31c39583b8343bd98bdc64d7659bd9a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d31c39583b8343bd98bdc64d7659bd9a"}]}] May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant: tempest-TestVolumeBootPattern-271887619 May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Id: d31c39583b8343bd98bdc64d7659bd9a May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-Tenant-Name: tempest-TestVolumeBootPattern-271887619 May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User: tempest-TestVolumeBootPattern-271887619-project May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Id: 4907ee21ee894003a8a237c99302ed88 May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: X-User-Name: tempest-TestVolumeBootPattern-271887619-project May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: method: > May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: exception: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.269437 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: action_args: {'id': 'f843def1-c182-4652-bac3-37e5d494cb3e'} May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:34:31.270420 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. May 10 03:34:31.271967 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi May 10 03:34:31.273353 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Returning 404 to user: Instance f843def1-c182-4652-bac3-37e5d494cb3e could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:34:31.273353 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-38e57483-54d2-4781-aef1-ef0c73b99cad tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e" status: 404 len: 111 microversion: 2.1 time: 0.028733 May 10 03:34:31.273353 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 540/1077] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 10 03:34:31 2022] GET /compute/v2.1/servers/f843def1-c182-4652-bac3-37e5d494cb3e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:34:32.552503 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-8be0ae65-d1fc-4f3d-83a5-a79648f63da4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] Calling method '.version_select at 0x7f14a4552ca0>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:34:32.555753 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8be0ae65-d1fc-4f3d-83a5-a79648f63da4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [34abf783-204b-47f3-a663-38faab272553] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:34:33.563939 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [None req-8be0ae65-d1fc-4f3d-83a5-a79648f63da4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] [34abf783-204b-47f3-a663-38faab272553] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 45382. May 10 03:34:33.583372 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-8be0ae65-d1fc-4f3d-83a5-a79648f63da4 tempest-TestVolumeBootPattern-271887619 tempest-TestVolumeBootPattern-271887619-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1710297732" status: 202 len: 0 microversion: 2.1 time: 1.035469 May 10 03:34:33.583943 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 538/1078] 10.222.0.55 () {58 vars in 1262 bytes} [Tue May 10 03:34:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1710297732 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:36:41.444964 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:36:41.445634 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Tue May 10 03:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:36:54.823765 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:36:54.824225 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Tue May 10 03:36:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:37:00.374995 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:37:00.375517 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Tue May 10 03:37:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:37:04.474229 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:37:04.474868 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Tue May 10 03:37:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:37:14.251158 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:37:14.251815 dv-cinder-830094-4-iscsi devstack@n-api.service[117120]: Tue May 10 03:37:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:38:43.092076 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:38:43.092631 dv-cinder-830094-4-iscsi devstack@n-api.service[117119]: Tue May 10 03:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!